--- license: apache-2.0 language: - en library_name: transformers pipeline_tag: text-generation tags: - coding - fableforge - generalist - gguf - imatrix - llama.cpp - lm-studio - nexus - ollama - reasoning - text-generation - uncensored --- # FableForge-1.5B > **FableForge generalist — all NEXUS domains distilled into one model.** [![Downloads](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhuggingface.co%2Fapi%2Fmodels%2Ffableforge-ai%2FFableForge-1.5B&query=downloads&label=downloads&color=blue)](https://huggingface.co/fableforge-ai/FableForge-1.5B) [![Demos](https://img.shields.io/badge/🤗-Live%20Demos-orange)](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) Part of the **FableForge** ecosystem. --- ## ⚡ Quickest start — Ollama (these pulls credit the source, not a mirror) ```bash ollama run hf.co/fableforge-ai/FableForge-1.5B:Q4_K_M ``` ## 🦙 llama.cpp ```bash llama-cli -hf fableforge-ai/FableForge-1.5B:Q4_K_M -p "Hello!" ``` ## 💠 LM Studio Search **`fableforge-ai/FableForge-1.5B`** and pick a quant below. --- ## 📦 Provided quants (download one file, not the whole repo) | File | Quant | Size | Notes | | ---- | ----- | ---- | ----- | | [fableforge-1.5b-f16.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-f16.gguf) | `F16` | 3.09 GB | Full precision (unquantized). Reference / conversion. | | [fableforge-1.5b-q8_0.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-q8_0.gguf) | `Q8_0` | 1.65 GB | Extremely high quality — usually overkill. | | [fableforge-1.5b-q6_k.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-q6_k.gguf) | `Q6_K` | 1.27 GB | Very high quality, near-perfect. **Recommended** if you have the RAM. | | [fableforge-1.5b-q5_k_m.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-q5_k_m.gguf) | `Q5_K_M` | 1.13 GB | High quality. **Recommended.** | | [fableforge-1.5b-q4_k_m.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-q4_k_m.gguf) | `Q4_K_M` | 0.99 GB | ⭐ **Best size/quality balance — default pick for most users.** | | [fableforge-1.5b-iq4_xs.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-iq4_xs.gguf) | `IQ4_XS` | 0.90 GB | imatrix — great quality, smaller than Q4_K_S. **Recommended for low RAM.** | | [fableforge-1.5b-q4_0.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-q4_0.gguf) | `Q4_0` | 0.93 GB | Legacy format — prefer Q4_K_M. | | [fableforge-1.5b-q3_k_m.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-q3_k_m.gguf) | `Q3_K_M` | 0.82 GB | Lower quality; usable when RAM is tight. | | [fableforge-1.5b-iq3_xxs.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-iq3_xxs.gguf) | `IQ3_XXS` | 0.67 GB | imatrix very low quality. | | [fableforge-1.5b-q2_k.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-q2_k.gguf) | `Q2_K` | 0.68 GB | Very low quality — surprisingly usable. | | [fableforge-1.5b-iq2_xxs.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B/blob/main/fableforge-1.5b-iq2_xxs.gguf) | `IQ2_XXS` | 0.51 GB | Tiny imatrix — last resort. | **Not sure?** Take **`Q4_K_M`**. Low RAM → **`IQ4_XS`**. Max quality → **`Q6_K`**. ## 🧠 Prompt format (ChatML) ``` <|im_start|>system {system_prompt}<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant ``` ## 🌌 See it live — the FableForge demos This family powers a galaxy of free, interactive HF Spaces: - 🧭 [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) - 🍺 [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc) - 🎭 [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator) - 💻 [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal) - 👻 [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer) --- ## 🔗 Related models - 📊 GGUF quants: [`FableForge-1.5B-GGUF`](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF) - 🔄 V2 (continued pretraining): [`FableForge-1.5B-v2`](https://huggingface.co/King3Djbl/FableForge-1.5B-v2) --- *⭐ Like & share — it helps people find the source instead of a mirror.*