33 lines
1.4 KiB
Markdown
33 lines
1.4 KiB
Markdown
|
---
|
|||
|
|
license: llama3.2
|
|||
|
|
base_model: meta-llama/Llama-3.2-3B-Instruct
|
|||
|
|
library_name: transformers
|
|||
|
|
tags: [le-harnais, ablation, retrain-only]
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# le-harnais / ft-counsel-Llama-3.2-3B-Instruct-regular-full-dom
|
|||
|
|
|
|||
|
|
> ⚠️ **retrain-only** — this is an ablation checkpoint, **not useful for inference**. It ships only to reproduce / continue the training study. For real use see the hero models: `le-harnais-ft-agentworld-{1b,3b,8b}`, `le-harnais-ft-counsel`.
|
|||
|
|
|
|||
|
|
Counsel-corpus ablation (scaling / data-augmentation / JEPA). JEPA ≈ +7 @3B, ≈0 @8B.
|
|||
|
|
|
|||
|
|
- **Base model:** [`meta-llama/Llama-3.2-3B-Instruct`](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) — **Built with Llama**; Llama Community License applies.
|
|||
|
|
- **Class:** `ablation`
|
|||
|
|
- **Training data:** datasets/counsel_train.jsonl (270 ex; wisdom+commentary, PD sources)
|
|||
|
|
- **Headline:** counsel-corpus scaling × augmentation × JEPA ablation (see docs/jepa.md)
|
|||
|
|
|
|||
|
|
## Reproduce
|
|||
|
|
|
|||
|
|
```sh
|
|||
|
|
see docs/jepa.md (counsel scaling grid)
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
Full recipe, datasets, and eval commands: see `docs/REPRODUCE.md` in the
|
|||
|
|
[le-harnais distribution]. Provenance & license: `docs/PROVENANCE.md`.
|
|||
|
|
|
|||
|
|
## Formats in this repo
|
|||
|
|
- `*.safetensors` — bf16 inference weights (serve with `transformers` or le-harnais `lh-serve`/candle).
|
|||
|
|
- `*.Q4_K_M.gguf` — portable 4-bit quant (run via `ollama` / `llama.cpp`; Mac-friendly).
|
|||
|
|
|
|||
|
|
> Orchestration amplifies a capable generator; it does not create competence.
|