---
base_model: Qwen/Qwen3-8B
base_model_relation: finetune
datasets:
- Glint-Research/Fable-5-traces
- Roman1111111/gpt5.5-terminal
license: apache-2.0
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- safetensors
- qlora
- agentic
- coding
- reasoning
- thinking
- claude
- qwen3
---

# Parable-Qwen3-8B-Claude-Fable-5

<picture>
  <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/ankit-aglawe/parable-assets/main/parable_header_dark.png">
  <img alt="Parable" src="https://raw.githubusercontent.com/ankit-aglawe/parable-assets/main/parable_header.png">
</picture>

**Qwen3-8B trained on real Claude Fable 5 and GPT-5.5 agent traces: 67% lower held-out test loss than its base, and the strongest strictly-graded qualitative score in the Parable series: 23 of 34 fully correct.**

Parable-Qwen3-8B is a [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) fine-tune trained on real multi-step agent sessions: planning, tool use, and `<think>` reasoning captured from actual Claude Fable 5 and GPT-5.5 agent work, not synthetic Q&A. Highest strict-qual release in the Parable series, alongside the [Granite 8B line](https://huggingface.co/AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5).

## Usage

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "AnkitAI/Parable-Qwen3-8B-Claude-Fable-5",
    torch_dtype="auto", device_map="auto")
tok = AutoTokenizer.from_pretrained("AnkitAI/Parable-Qwen3-8B-Claude-Fable-5")

msgs = [{"role": "user", "content": "Write a Python function that retries an HTTP request with exponential backoff."}]
ids = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to(model.device)
out = model.generate(ids, max_new_tokens=3000, temperature=0.7, top_p=0.95, do_sample=True)
text = tok.decode(out[0][ids.shape[1]:], skip_special_tokens=True)
answer = text.split("</think>")[-1].strip()  # response opens with a <think> block
print(answer)
```

GGUF quants for llama.cpp / Ollama / LM Studio: [Parable-Qwen3-8B-Claude-Fable-5-GGUF](https://huggingface.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF).

**Sampling:** temperature 0.7, top_p 0.95, generous max_new_tokens (at least 2500).

## Training data

- [Glint-Research/Fable-5-traces](https://huggingface.co/datasets/Glint-Research/Fable-5-traces): 4.4k real Claude Fable 5 coding-agent session traces with `<think>` reasoning and tool calls (AGPL-3.0)
- [Roman1111111/gpt5.5-terminal](https://huggingface.co/datasets/Roman1111111/gpt5.5-terminal): terminal-agent task solutions (MIT)

Every example passed a quality gate (schema validation, secrets scrub, length filtering) before training. QLoRA fine-tune (NF4, sequence length 1024) trained on a single 16 GB GPU, quantized with [llama.cpp](https://github.com/ggml-org/llama.cpp).

## Evaluation

![Held-out evals across the Parable family](https://raw.githubusercontent.com/ankit-aglawe/parable-assets/main/parable_evals.png)

Held-out test split, identical evaluation code and context length for base and fine-tune:

| Metric | Base Qwen3-8B | Parable | Δ |
|---|---|---|---|
| Test loss | 2.162 | **0.712** | **−67%** |

**Qualitative review** (34 coding/terminal/debugging prompts, strictly graded by mentally executing every answer): **23/34 fully correct, 30/34 correct or partially correct** — the highest fully-correct score in the series. We publish these numbers because strict qualitative grading is rare in this niche; judge accordingly.

For reference, the strongest published fine-tune on this data family (a 9B) reports 0.71 validation loss. Cross-repo numbers are indicative only: splits, tokenizers, and context lengths differ (ours is measured at 1,024 tokens).

## Limitations

- Trained for agent work: on ops-style prompts it sometimes (2/34 in our eval) responds with structured tool-call JSON rather than prose. Useful inside agent harnesses; in plain chat, re-prompt or lower the temperature.
- Fine-tuned at 1,024-token sequences; the base model's native 128K-token context remains fully available, so long sessions work, with the fine-tuned behavior strongest in the opening turns.

As a fine-tune it inherits Qwen3-8B's base behaviors and knowledge cutoff. As with any local model, treat generated commands and code as drafts to review.

## Provenance & licensing

Model weights: **Apache-2.0** (inherited from Qwen3-8B). Training data licenses: Fable-5-traces **AGPL-3.0**, gpt5.5-terminal **MIT**. Because those traces originate from third-party assistants, the providers' terms may apply to downstream training and distillation. If you plan to build on this model commercially, confirm your use aligns with those terms.


## Get Parable

| Platform | Command / Link |
|---|---|
| Ollama | `ollama run parable/qwen3-fable:8b` |
| Ollama (family flagship, best per size) | `ollama run parable/fable` |
| Hugging Face | [GGUF quants, full weights, eval reports](https://huggingface.co/collections/AnkitAI/parable-6a4fac60f4b35afca3019621) |
| LM Studio | `lms get parable/qwen3-fable` ([parable on LM Studio Hub](https://lmstudio.ai/parable)) |

## Acknowledgements

- [Glint-Research](https://huggingface.co/Glint-Research) and [Roman1111111](https://huggingface.co/Roman1111111) for the open trace datasets
- [Qwen](https://huggingface.co/Qwen) for the base model
- [empero-ai](https://huggingface.co/empero-ai), whose Qwable recipe the Parable series follows
- [llama.cpp](https://github.com/ggml-org/llama.cpp)