初始化项目,由ModelHub XC社区提供模型
Model: AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF Source: Original Platform
This commit is contained in:
44
.gitattributes
vendored
Normal file
44
.gitattributes
vendored
Normal file
@@ -0,0 +1,44 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-4B-fable-agentic-GGUF-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-4B-fable-agentic-GGUF-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-4B-fable-agentic-GGUF-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-4B-fable-agentic-GGUF-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Parable-Qwen3-4B-Claude-Fable-5-GGUF-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-F16.gguf
Normal file
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f6c2220ab470c6f012965888dde3f9e1a8bc3d829bcb64b872d8d81d8e185f7e
|
||||||
|
size 8051284800
|
||||||
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q4_K_M.gguf
Normal file
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4b94ae1f56142eb04dc54f810fece7bc904a8ff855169b8ec4e57a366c9eabcc
|
||||||
|
size 2497280320
|
||||||
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q5_K_M.gguf
Normal file
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:76200de852de38fa9ddc11c1a13c95e567f1f8d889c41d22ee3d3eaf5333674d
|
||||||
|
size 2889513280
|
||||||
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q6_K.gguf
Normal file
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:936f508ac1dfc93adc53d396b42bbb73622ddae7f6df8194ee650236fa069cbe
|
||||||
|
size 3306260800
|
||||||
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q8_0.gguf
Normal file
3
Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7b9b99a25c3511bea7a16ebf2c5dc83188e885b5a7e75a914a90eacb684d75fd
|
||||||
|
size 4280404800
|
||||||
143
README.md
Normal file
143
README.md
Normal file
@@ -0,0 +1,143 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
base_model: Qwen/Qwen3-4B
|
||||||
|
datasets:
|
||||||
|
- Glint-Research/Fable-5-traces
|
||||||
|
- Roman1111111/gpt5.5-terminal
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
library_name: llama.cpp
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- qlora
|
||||||
|
- agentic
|
||||||
|
- coding
|
||||||
|
- reasoning
|
||||||
|
- qwen3
|
||||||
|
- local-llm
|
||||||
|
- ollama
|
||||||
|
- lm-studio
|
||||||
|
---
|
||||||
|
|
||||||
|
# Parable-Qwen3-4B-Claude-Fable-5-GGUF
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
**A 4B local coding model with agent instincts.** Planning, tool habits and
|
||||||
|
terminal reasoning distilled from real Claude Fable 5 agent sessions, not
|
||||||
|
synthetic Q&A. Runs on ~2.5 GB of RAM.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
ollama run hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:Q4_K_M
|
||||||
|
```
|
||||||
|
|
||||||
|
## v3.1 (2026-08-11)
|
||||||
|
|
||||||
|
Retrained on **corpus v3.1**: the v2 agent traces plus 1,807 execution-verified
|
||||||
|
solutions generated by the previous build and kept only where the code actually
|
||||||
|
ran against its tests. Two seeds souped, merged at the v2.1 scale.
|
||||||
|
|
||||||
|
The result **matches or beats base Qwen3-4B on all four execution benchmarks**,
|
||||||
|
where the previous build trailed it on three. If you pulled this model before
|
||||||
|
11 August 2026, re-pull.
|
||||||
|
|
||||||
|
## Files
|
||||||
|
|
||||||
|
| File | Quant | Size | |
|
||||||
|
|---|---|---|---|
|
||||||
|
| Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q4_K_M.gguf | Q4_K_M | 2.5 GB | **recommended** |
|
||||||
|
| Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q5_K_M.gguf | Q5_K_M | 2.9 GB | |
|
||||||
|
| Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q6_K.gguf | Q6_K | 3.3 GB | |
|
||||||
|
| Parable-Qwen3-4B-Claude-Fable-5-GGUF-Q8_0.gguf | Q8_0 | 4.3 GB | |
|
||||||
|
| Parable-Qwen3-4B-Claude-Fable-5-GGUF-F16.gguf | F16 | 8.1 GB | for re-quantizing |
|
||||||
|
|
||||||
|
## What it is good at
|
||||||
|
|
||||||
|
- **It answers.** Base Qwen3-4B spends its whole budget inside `<think>` on
|
||||||
|
34% of ordinary prompts and returns nothing. This model answers 34/34 on
|
||||||
|
the same suite, with 140x less reasoning text and no thinking-mode flag to
|
||||||
|
manage.
|
||||||
|
- **Agent-shaped reasoning.** Trained on genuine multi-step agent sessions,
|
||||||
|
so plans, tool selection and terminal workflows come out structured
|
||||||
|
instead of improvised.
|
||||||
|
- **Small enough to keep open.** Q4_K_M is 2.5 GB. Laptop, old GPU, modest
|
||||||
|
desktop — it runs, offline, with your code staying on your machine.
|
||||||
|
|
||||||
|
## Evaluation
|
||||||
|
|
||||||
|
Measured on identical harnesses, greedy decoding, Q4_K_M builds, thinking
|
||||||
|
disabled on every row. Base and this model run through the same instrument in
|
||||||
|
the same session.
|
||||||
|
|
||||||
|
| | Base Qwen3-4B | **This model (v3.1)** |
|
||||||
|
|---|---|---|
|
||||||
|
| HumanEval | 73.2 | **74.4** |
|
||||||
|
| HumanEval+ | 68.3 | **68.3** |
|
||||||
|
| MBPP | 69.0 | **72.8** |
|
||||||
|
| MBPP+ | 59.8 | **63.8** |
|
||||||
|
| Held-out agent-trace loss | 2.155 | **1.446** |
|
||||||
|
|
||||||
|
Measured on the v2.1 build and carried forward (the training objective and
|
||||||
|
chat behaviour are unchanged):
|
||||||
|
|
||||||
|
| | Base Qwen3-4B | Parable |
|
||||||
|
|---|---|---|
|
||||||
|
| Prompts answered (34-prompt suite) | 27/34 | **34/34** |
|
||||||
|
| BFCL simple_python | 95.3 | 92.3 |
|
||||||
|
| BFCL multiple | 94.5 | 90.0 |
|
||||||
|
|
||||||
|
## Choosing between this and the base
|
||||||
|
|
||||||
|
Take **this model** for local agent and coding work where you want
|
||||||
|
structured, reliable answers every time: it fits the agent-session
|
||||||
|
distribution far better and never silently returns empty.
|
||||||
|
|
||||||
|
Take the **base model** if your workload is maximum-accuracy function
|
||||||
|
calling in a tool-calling harness, where its few extra points matter more
|
||||||
|
than reasoning style.
|
||||||
|
|
||||||
|
## Model details
|
||||||
|
|
||||||
|
- **Base:** [Qwen/Qwen3-4B](https://huggingface.co/Qwen/Qwen3-4B) (4B, Apache-2.0)
|
||||||
|
- **Method:** QLoRA (nf4, r16, alpha 32) on all-linear targets, completion-only
|
||||||
|
loss masking, 30% general-instruction replay mix, seed-averaged weights,
|
||||||
|
merged at scale 0.6 (v2.1 recalibration)
|
||||||
|
- **Data:** genuine Claude Fable 5 agent sessions + gpt5.5-terminal
|
||||||
|
transcripts, deduplicated and decontaminated against the reported benchmarks
|
||||||
|
- **Method report:** [doi:10.5281/zenodo.21676407](https://doi.org/10.5281/zenodo.21676407)
|
||||||
|
|
||||||
|
## Provenance & licensing
|
||||||
|
|
||||||
|
Fine-tuned from Qwen/Qwen3-4B (Apache-2.0). Training data:
|
||||||
|
[Glint-Research/Fable-5-traces](https://huggingface.co/datasets/Glint-Research/Fable-5-traces)
|
||||||
|
(AGPL-3.0) and
|
||||||
|
[Roman1111111/gpt5.5-terminal](https://huggingface.co/datasets/Roman1111111/gpt5.5-terminal)
|
||||||
|
(MIT). Because those traces originate from third-party assistants, the
|
||||||
|
providers' terms may apply to downstream training and distillation. If you
|
||||||
|
plan to build on this model commercially, confirm your use aligns with those
|
||||||
|
terms.
|
||||||
|
|
||||||
|
## Support the Project
|
||||||
|
|
||||||
|
If this model is useful in your work, you can support independent research:
|
||||||
|
|
||||||
|
<p align="left">
|
||||||
|
<a href="https://www.buymeacoffee.com/AnkitAI" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me a Coffee" height="60" width="217" /></a>
|
||||||
|
</p>
|
||||||
|
|
||||||
|
## Citation
|
||||||
|
|
||||||
|
```bibtex
|
||||||
|
@misc{aglawe2026agenttrace,
|
||||||
|
author = {Aglawe, Ankit},
|
||||||
|
title = {Agent-Trace Fine-Tuning of Small Language Models under Constrained Compute},
|
||||||
|
year = {2026},
|
||||||
|
publisher = {Zenodo},
|
||||||
|
doi = {10.5281/zenodo.21676407},
|
||||||
|
url = {https://doi.org/10.5281/zenodo.21676407}
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
## Acknowledgements
|
||||||
|
|
||||||
|
The Qwen team for the base model; Glint-Research and Roman1111111 for the
|
||||||
|
trace datasets; empero-ai for the recipe this series iterates on.
|
||||||
96
banner.svg
Normal file
96
banner.svg
Normal file
File diff suppressed because one or more lines are too long
|
After Width: | Height: | Size: 719 KiB |
Reference in New Issue
Block a user