初始化项目,由ModelHub XC社区提供模型
Model: posttrainllm/qwen3-4b-file-ops-distilled Source: Original Platform
This commit is contained in:
72
README.md
Normal file
72
README.md
Normal file
@@ -0,0 +1,72 @@
|
||||
---
|
||||
base_model: Qwen/Qwen3-4B-Instruct-2507
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: other
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- tinygpt
|
||||
- mlx
|
||||
- tool-calling
|
||||
- function-calling
|
||||
- agentic
|
||||
- file-ops
|
||||
---
|
||||
|
||||
# Qwen3-4B File-Ops Distilled
|
||||
|
||||
## Summary
|
||||
|
||||
This is the first TinyGPT specialist package for a model we actually built:
|
||||
a fused Qwen3-4B-Instruct-2507 bf16 HF/MLX safetensors directory distilled for
|
||||
GorillaFileSystem multi-turn file-operation tasks.
|
||||
|
||||
It is a **routed specialist**, not the general Pace planner.
|
||||
|
||||
## Artifact
|
||||
|
||||
- Package id: `qwen3-4b-file-ops-distilled`
|
||||
- Public artifact: `sarthakagrawal927/qwen3-4b-file-ops-distilled`
|
||||
- Public storage target: Hugging Face Hub model repo
|
||||
- Format: HF/MLX safetensors directory
|
||||
- Base: `Qwen/Qwen3-4B-Instruct-2507`
|
||||
- Precision: bf16
|
||||
- Training method: frontier/gold trajectory distillation rendered in the
|
||||
student's native tool-calling chat template
|
||||
|
||||
## Measured Result
|
||||
|
||||
| Suite | Stock 4B | Distilled 4B |
|
||||
|---|---:|---:|
|
||||
| File-ops hard gate | 58% | 100% |
|
||||
| File-ops hardgen held-out | - | 95% |
|
||||
| Out-of-domain breadth | 59.6% | 42.3% |
|
||||
|
||||
The file-ops domain saturated at 4B: the distilled model matched frontier on
|
||||
the hard and veryhard file-ops gates. The same training caused negative
|
||||
transfer outside that domain, so this package is only correct behind a router.
|
||||
|
||||
## Recommended Use
|
||||
|
||||
Use this model when the router has already identified a file-operation task
|
||||
with derivable arguments: paths, file names, directories, moves, creates,
|
||||
deletes, and navigation through a file-system backend.
|
||||
|
||||
Do not use it as a general planner. For general multi-domain planning, use the
|
||||
planner lock in `docs/planner-lock-2026-06-19.md`: stock
|
||||
Qwen3-4B-Instruct-2507 bf16 with the plan-then-execute prompt.
|
||||
|
||||
## Known Limits
|
||||
|
||||
- The specialist regresses on non-filesystem BFCL multi-turn backends.
|
||||
- It was not validated as a broad Pace planner.
|
||||
- It depends on correct routing. Bad routing turns a narrow win into a broad
|
||||
regression.
|
||||
- The artifact is multi-GB and is published on Hugging Face Hub, not committed
|
||||
to this repository or required to remain in local cache.
|
||||
|
||||
## References
|
||||
|
||||
- `docs/learn/tool-calling-frontier-parity.md` sections 8.1-8.5
|
||||
- `docs/planner-lock-2026-06-19.md`
|
||||
Reference in New Issue
Block a user