4.2 KiB
4.2 KiB
license, language, library_name, pipeline_tag, base_model, base_model_relation, quantized_by, tags
| license | language | library_name | pipeline_tag | base_model | base_model_relation | quantized_by | tags | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| apache-2.0 |
|
transformers | text-generation | fableforge-ai/ShellWhisperer-1.5B | finetune | King3Djbl |
|
FableForge-1.5B
FableForge generalist — all NEXUS domains distilled into one model.
Base model: Qwen/Qwen2.5-1.5B-Instruct · Part of the FableForge ecosystem.
⚡ Quickest start — Ollama (these pulls credit the source, not a mirror)
ollama run hf.co/King3Djbl/FableForge-1.5B:Q4_K_M
🦙 llama.cpp
llama-cli -hf King3Djbl/FableForge-1.5B:Q4_K_M -p "Hello!"
💠 LM Studio
Search King3Djbl/FableForge-1.5B and pick a quant below.
📦 Provided quants (download one file, not the whole repo)
| File | Quant | Size | Notes |
|---|---|---|---|
| fableforge-1.5b-f16.gguf | F16 |
3.09 GB | Full precision (unquantized). Reference / conversion. |
| fableforge-1.5b-q8_0.gguf | Q8_0 |
1.65 GB | Extremely high quality — usually overkill. |
| fableforge-1.5b-q6_k.gguf | Q6_K |
1.27 GB | Very high quality, near-perfect. Recommended if you have the RAM. |
| fableforge-1.5b-q5_k_m.gguf | Q5_K_M |
1.13 GB | High quality. Recommended. |
| fableforge-1.5b-q4_k_m.gguf | Q4_K_M |
0.99 GB | ⭐ Best size/quality balance — default pick for most users. |
| fableforge-1.5b-iq4_xs.gguf | IQ4_XS |
0.90 GB | imatrix — great quality, smaller than Q4_K_S. Recommended for low RAM. |
| fableforge-1.5b-q4_0.gguf | Q4_0 |
0.93 GB | Legacy format — prefer Q4_K_M. |
| fableforge-1.5b-q3_k_m.gguf | Q3_K_M |
0.82 GB | Lower quality; usable when RAM is tight. |
| fableforge-1.5b-iq3_xxs.gguf | IQ3_XXS |
0.67 GB | imatrix very low quality. |
| fableforge-1.5b-q2_k.gguf | Q2_K |
0.68 GB | Very low quality — surprisingly usable. |
| fableforge-1.5b-iq2_xxs.gguf | IQ2_XXS |
0.51 GB | Tiny imatrix — last resort. |
Not sure? Take Q4_K_M. Low RAM → IQ4_XS. Max quality → Q6_K.
🧠 Prompt format (ChatML)
<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
🌌 See it live — the FableForge demos
This family powers a galaxy of free, interactive HF Spaces:
⭐ Like & share — it helps people find the source instead of a mirror.