73 lines
2.2 KiB
Markdown
73 lines
2.2 KiB
Markdown
|
---
|
||
|
|
base_model: Qwen/Qwen3-4B-Instruct-2507
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
library_name: transformers
|
||
|
|
license: other
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
tags:
|
||
|
|
- tinygpt
|
||
|
|
- mlx
|
||
|
|
- tool-calling
|
||
|
|
- function-calling
|
||
|
|
- agentic
|
||
|
|
- file-ops
|
||
|
|
---
|
||
|
|
|
||
|
|
# Qwen3-4B File-Ops Distilled
|
||
|
|
|
||
|
|
## Summary
|
||
|
|
|
||
|
|
This is the first TinyGPT specialist package for a model we actually built:
|
||
|
|
a fused Qwen3-4B-Instruct-2507 bf16 HF/MLX safetensors directory distilled for
|
||
|
|
GorillaFileSystem multi-turn file-operation tasks.
|
||
|
|
|
||
|
|
It is a **routed specialist**, not the general Pace planner.
|
||
|
|
|
||
|
|
## Artifact
|
||
|
|
|
||
|
|
- Package id: `qwen3-4b-file-ops-distilled`
|
||
|
|
- Public artifact: `sarthakagrawal927/qwen3-4b-file-ops-distilled`
|
||
|
|
- Public storage target: Hugging Face Hub model repo
|
||
|
|
- Format: HF/MLX safetensors directory
|
||
|
|
- Base: `Qwen/Qwen3-4B-Instruct-2507`
|
||
|
|
- Precision: bf16
|
||
|
|
- Training method: frontier/gold trajectory distillation rendered in the
|
||
|
|
student's native tool-calling chat template
|
||
|
|
|
||
|
|
## Measured Result
|
||
|
|
|
||
|
|
| Suite | Stock 4B | Distilled 4B |
|
||
|
|
|---|---:|---:|
|
||
|
|
| File-ops hard gate | 58% | 100% |
|
||
|
|
| File-ops hardgen held-out | - | 95% |
|
||
|
|
| Out-of-domain breadth | 59.6% | 42.3% |
|
||
|
|
|
||
|
|
The file-ops domain saturated at 4B: the distilled model matched frontier on
|
||
|
|
the hard and veryhard file-ops gates. The same training caused negative
|
||
|
|
transfer outside that domain, so this package is only correct behind a router.
|
||
|
|
|
||
|
|
## Recommended Use
|
||
|
|
|
||
|
|
Use this model when the router has already identified a file-operation task
|
||
|
|
with derivable arguments: paths, file names, directories, moves, creates,
|
||
|
|
deletes, and navigation through a file-system backend.
|
||
|
|
|
||
|
|
Do not use it as a general planner. For general multi-domain planning, use the
|
||
|
|
planner lock in `docs/planner-lock-2026-06-19.md`: stock
|
||
|
|
Qwen3-4B-Instruct-2507 bf16 with the plan-then-execute prompt.
|
||
|
|
|
||
|
|
## Known Limits
|
||
|
|
|
||
|
|
- The specialist regresses on non-filesystem BFCL multi-turn backends.
|
||
|
|
- It was not validated as a broad Pace planner.
|
||
|
|
- It depends on correct routing. Bad routing turns a narrow win into a broad
|
||
|
|
regression.
|
||
|
|
- The artifact is multi-GB and is published on Hugging Face Hub, not committed
|
||
|
|
to this repository or required to remain in local cache.
|
||
|
|
|
||
|
|
## References
|
||
|
|
|
||
|
|
- `docs/learn/tool-calling-frontier-parity.md` sections 8.1-8.5
|
||
|
|
- `docs/planner-lock-2026-06-19.md`
|