初始化项目,由ModelHub XC社区提供模型
Model: astom-M/matsuo-llm-advanced-phase-f2a Source: Original Platform
This commit is contained in:
56
README.md
Normal file
56
README.md
Normal file
@@ -0,0 +1,56 @@
|
||||
---
|
||||
language:
|
||||
- ja
|
||||
- en
|
||||
license: apache-2.0
|
||||
base_model: Qwen/Qwen2.5-7B-Instruct
|
||||
tags:
|
||||
- text-generation
|
||||
- agent
|
||||
- sql
|
||||
- alfworld
|
||||
- dbagent
|
||||
---
|
||||
|
||||
# matsuo-llm-advanced-phase-f2a
|
||||
|
||||
Fine-tuned from Qwen/Qwen2.5-7B-Instruct for agent tasks.
|
||||
|
||||
## Training Configuration
|
||||
|
||||
- LoRA: r=8, alpha=16 (Phase D identical)
|
||||
- lr: 1e-5, epochs: 0.3, batch: 4x4=16
|
||||
- Data: Spider/BIRD 2100 (60%) + Distilled 72B 500 (14%) + DBBench v4 700 (20%) + ALFWorld 200 (6%), 3500 samples
|
||||
|
||||
## Data Composition
|
||||
|
||||
- Spider/BIRD: 2100 samples (60%) - reduced from Phase D to accommodate distilled data
|
||||
- Distilled 72B: 500 samples (14%) - NEW: multi-turn DB conversations generated by Qwen2.5-72B-Instruct-AWQ
|
||||
- Generated from Spider/BIRD table schemas (not from AgentBench data)
|
||||
- Weak category emphasis (AGG-MAX, COUNT, INSERT, AGG-SUM)
|
||||
- Filtered by regex/sqlparse only (no LLM quality filtering)
|
||||
- DBBench v4: 700 samples (20%) - same as Phase D
|
||||
- ALFWorld v5: 200 samples (6%) - reduced from Phase D
|
||||
|
||||
## Datasets
|
||||
|
||||
- `u-10bei/dbbench_sft_dataset_react_v4` — Listed in the organizer-shared Phase B dataset list.
|
||||
Used as provided (no modification). Third-party synthetic SFT for DBBench format alignment;
|
||||
all tables, data, and queries are independently generated
|
||||
(per dataset description: "to avoid test data leakage").
|
||||
- `xlangai/spider` — CC BY-SA 4.0 (Yale/Columbia Spider project)
|
||||
- `birdsql/bird_mini_dev` — CC BY-SA 4.0 (HKU)
|
||||
- Official Phase B ALFWorld v5 dataset — Organizer-provided, used as provided.
|
||||
- Synthetic multi-turn data generated by Qwen2.5-72B-Instruct-AWQ (whitelisted model)
|
||||
|
||||
## Compliance
|
||||
|
||||
- Evaluation data not used in training: No analysis of evaluation test data was conducted.
|
||||
- LLM was not used for data quality filtering or selection.
|
||||
- Distilled data generated from whitelisted model (Qwen2.5-72B-Instruct-AWQ) using Spider/BIRD schemas only.
|
||||
- Filtering is regex/sqlparse only (non-LLM).
|
||||
- Inference code not modified.
|
||||
|
||||
## Usage
|
||||
|
||||
Compatible with vLLM v0.13.0+.
|
||||
Reference in New Issue
Block a user