From 10a939329aa0c030d02d07ebfd3676de95fedde3 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Sat, 8 Aug 2026 02:53:16 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: fableforge-ai/FableForge-1.5B-GGUF Source: Original Platform --- .gitattributes | 60 +++++++++++++++++++++ FableForge-1.5B-F16.gguf | 3 ++ FableForge-1.5B-IQ1_S.gguf | 3 ++ FableForge-1.5B-IQ2_XXS.gguf | 3 ++ FableForge-1.5B-IQ3_XXS.gguf | 3 ++ FableForge-1.5B-IQ4_XS.gguf | 3 ++ FableForge-1.5B-Q2_K.gguf | 3 ++ FableForge-1.5B-Q3_K_M.gguf | 3 ++ FableForge-1.5B-Q4_0.gguf | 3 ++ FableForge-1.5B-Q4_K_M.gguf | 3 ++ FableForge-1.5B-Q5_K_M.gguf | 3 ++ FableForge-1.5B-Q6_K.gguf | 3 ++ FableForge-1.5B-Q8_0.gguf | 3 ++ FableForge-1.5B-imatrix.dat | 3 ++ FableForge-1.5B-imatrix.gguf | 3 ++ FableForge-1.5B-iq2_s.gguf | 3 ++ FableForge-1.5B-iq2_xs.gguf | 3 ++ FableForge-1.5B-iq3_m.gguf | 3 ++ FableForge-1.5B-iq3_s.gguf | 3 ++ FableForge-1.5B-iq3_xs.gguf | 3 ++ FableForge-1.5B-iq4_nl.gguf | 3 ++ FableForge-1.5B-q3_k_l.gguf | 3 ++ FableForge-1.5B-q3_k_s.gguf | 3 ++ FableForge-1.5B-q4_1.gguf | 3 ++ FableForge-1.5B-q4_k_s.gguf | 3 ++ FableForge-1.5B-q5_k_s.gguf | 3 ++ README.md | 100 +++++++++++++++++++++++++++++++++++ 27 files changed, 235 insertions(+) create mode 100644 .gitattributes create mode 100644 FableForge-1.5B-F16.gguf create mode 100644 FableForge-1.5B-IQ1_S.gguf create mode 100644 FableForge-1.5B-IQ2_XXS.gguf create mode 100644 FableForge-1.5B-IQ3_XXS.gguf create mode 100644 FableForge-1.5B-IQ4_XS.gguf create mode 100644 FableForge-1.5B-Q2_K.gguf create mode 100644 FableForge-1.5B-Q3_K_M.gguf create mode 100644 FableForge-1.5B-Q4_0.gguf create mode 100644 FableForge-1.5B-Q4_K_M.gguf create mode 100644 FableForge-1.5B-Q5_K_M.gguf create mode 100644 FableForge-1.5B-Q6_K.gguf create mode 100644 FableForge-1.5B-Q8_0.gguf create mode 100644 FableForge-1.5B-imatrix.dat create mode 100644 FableForge-1.5B-imatrix.gguf create mode 100644 FableForge-1.5B-iq2_s.gguf create mode 100644 FableForge-1.5B-iq2_xs.gguf create mode 100644 FableForge-1.5B-iq3_m.gguf create mode 100644 FableForge-1.5B-iq3_s.gguf create mode 100644 FableForge-1.5B-iq3_xs.gguf create mode 100644 FableForge-1.5B-iq4_nl.gguf create mode 100644 FableForge-1.5B-q3_k_l.gguf create mode 100644 FableForge-1.5B-q3_k_s.gguf create mode 100644 FableForge-1.5B-q4_1.gguf create mode 100644 FableForge-1.5B-q4_k_s.gguf create mode 100644 FableForge-1.5B-q5_k_s.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..c469e10 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-F16.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-imatrix.dat filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-imatrix.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-iq2_s.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-iq2_xs.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-iq3_m.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-iq3_s.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-iq3_xs.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-iq4_nl.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-q4_1.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text +FableForge-1.5B-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/FableForge-1.5B-F16.gguf b/FableForge-1.5B-F16.gguf new file mode 100644 index 0000000..eb89264 --- /dev/null +++ b/FableForge-1.5B-F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ae6d277832358dd5732a377c35482f51b967c5b02ad47908b2d73fd8c1a0dca1 +size 3093666592 diff --git a/FableForge-1.5B-IQ1_S.gguf b/FableForge-1.5B-IQ1_S.gguf new file mode 100644 index 0000000..9e4315b --- /dev/null +++ b/FableForge-1.5B-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e1d779d4e80c9dcb537556305be9a73aed33be0bb3de1317fd8f819d7eaed10 +size 436525088 diff --git a/FableForge-1.5B-IQ2_XXS.gguf b/FableForge-1.5B-IQ2_XXS.gguf new file mode 100644 index 0000000..f480276 --- /dev/null +++ b/FableForge-1.5B-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e093979ddb1e17eb85c2558941f15746fe21dc4584715e679e4deb460b6a3eea +size 511014976 diff --git a/FableForge-1.5B-IQ3_XXS.gguf b/FableForge-1.5B-IQ3_XXS.gguf new file mode 100644 index 0000000..bde89d8 --- /dev/null +++ b/FableForge-1.5B-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5b8e6af0130102f3fdb39a0dff7ee6b46cc8c5be858f7364fc88d188c331a71e +size 668789824 diff --git a/FableForge-1.5B-IQ4_XS.gguf b/FableForge-1.5B-IQ4_XS.gguf new file mode 100644 index 0000000..f6d6972 --- /dev/null +++ b/FableForge-1.5B-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d92707dd3f561f55fcbd0962830ac3f310ad18925aa918d163895c857c3824a6 +size 895729216 diff --git a/FableForge-1.5B-Q2_K.gguf b/FableForge-1.5B-Q2_K.gguf new file mode 100644 index 0000000..0c1688a --- /dev/null +++ b/FableForge-1.5B-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9f65b78aad7e85b0387a63da12a9ea60b2c23b83016da89e3524f7b1c24105a +size 676302112 diff --git a/FableForge-1.5B-Q3_K_M.gguf b/FableForge-1.5B-Q3_K_M.gguf new file mode 100644 index 0000000..190eee9 --- /dev/null +++ b/FableForge-1.5B-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09cac974bd3d4bdef28e208becd50351d4700c35b9e3420821ee0bbedf2ab043 +size 911428672 diff --git a/FableForge-1.5B-Q4_0.gguf b/FableForge-1.5B-Q4_0.gguf new file mode 100644 index 0000000..35408e9 --- /dev/null +++ b/FableForge-1.5B-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:484968a8c4e1a3e304dcd5d5a08593c3b771dd71abde0be7b386dc85eb06aab0 +size 991472416 diff --git a/FableForge-1.5B-Q4_K_M.gguf b/FableForge-1.5B-Q4_K_M.gguf new file mode 100644 index 0000000..c633306 --- /dev/null +++ b/FableForge-1.5B-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ba01779e339d8cb551b7d8399ff02d8028558b93abc9e97ec87e80ec5c834af5 +size 1057348672 diff --git a/FableForge-1.5B-Q5_K_M.gguf b/FableForge-1.5B-Q5_K_M.gguf new file mode 100644 index 0000000..15fc640 --- /dev/null +++ b/FableForge-1.5B-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:881fd73e88a81d0202918271bc76aef6bbe04a7a78ccc74efabd6901b27c74b4 +size 1207262272 diff --git a/FableForge-1.5B-Q6_K.gguf b/FableForge-1.5B-Q6_K.gguf new file mode 100644 index 0000000..b177609 --- /dev/null +++ b/FableForge-1.5B-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7bd3a03698eb89b7398a933761bf07954aaa1c6572ed69ec4c6644ad8836c926 +size 1329257536 diff --git a/FableForge-1.5B-Q8_0.gguf b/FableForge-1.5B-Q8_0.gguf new file mode 100644 index 0000000..3299a66 --- /dev/null +++ b/FableForge-1.5B-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b1957988cbea7c391fae39aa232d147874df8f921cf6143b0164b137b098ef3 +size 1646570272 diff --git a/FableForge-1.5B-imatrix.dat b/FableForge-1.5B-imatrix.dat new file mode 100644 index 0000000..636d403 --- /dev/null +++ b/FableForge-1.5B-imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eed3a55cccc7f15eedbdfb1d33ed103ad27abdf5f0366e62579707bfbe0a8e61 +size 2065920 diff --git a/FableForge-1.5B-imatrix.gguf b/FableForge-1.5B-imatrix.gguf new file mode 100644 index 0000000..636d403 --- /dev/null +++ b/FableForge-1.5B-imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eed3a55cccc7f15eedbdfb1d33ed103ad27abdf5f0366e62579707bfbe0a8e61 +size 2065920 diff --git a/FableForge-1.5B-iq2_s.gguf b/FableForge-1.5B-iq2_s.gguf new file mode 100644 index 0000000..68c4570 --- /dev/null +++ b/FableForge-1.5B-iq2_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e05a571fdf63ff02b79b55dd7bdfceaed01b25bf4bd5c11c2648e84e46fb6d06 +size 563807264 diff --git a/FableForge-1.5B-iq2_xs.gguf b/FableForge-1.5B-iq2_xs.gguf new file mode 100644 index 0000000..cc36e78 --- /dev/null +++ b/FableForge-1.5B-iq2_xs.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4d6afade86e8a881b0994b33f30b1fd249ffa32585bc6d75d99e74972e0edb74 +size 550324256 diff --git a/FableForge-1.5B-iq3_m.gguf b/FableForge-1.5B-iq3_m.gguf new file mode 100644 index 0000000..6d495e9 --- /dev/null +++ b/FableForge-1.5B-iq3_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a1f25b283895c34125217961edd2c760b9dd5dd17681aad67f6fbbec368a14c6 +size 776661536 diff --git a/FableForge-1.5B-iq3_s.gguf b/FableForge-1.5B-iq3_s.gguf new file mode 100644 index 0000000..336cc93 --- /dev/null +++ b/FableForge-1.5B-iq3_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:060f34eb473f7d544b0d26653a516dd07086e660c327a58fa4fed42abb95ceb6 +size 762404384 diff --git a/FableForge-1.5B-iq3_xs.gguf b/FableForge-1.5B-iq3_xs.gguf new file mode 100644 index 0000000..e48587c --- /dev/null +++ b/FableForge-1.5B-iq3_xs.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65e9b87f937feba9a07766ebf6c680c4267f80af7d848c65b48c2148fdffd8a6 +size 731696672 diff --git a/FableForge-1.5B-iq4_nl.gguf b/FableForge-1.5B-iq4_nl.gguf new file mode 100644 index 0000000..c33322b --- /dev/null +++ b/FableForge-1.5B-iq4_nl.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd7fce0a3fe571020e6cdd5207aa76a529165bdb2bb359ad21e36cb47e201b35 +size 936328736 diff --git a/FableForge-1.5B-q3_k_l.gguf b/FableForge-1.5B-q3_k_l.gguf new file mode 100644 index 0000000..d393b44 --- /dev/null +++ b/FableForge-1.5B-q3_k_l.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6870da02f5fe4cbb828103a3e4c5bc8f5ba530c1c999a2812fc375c03fbb2cff +size 880160032 diff --git a/FableForge-1.5B-q3_k_s.gguf b/FableForge-1.5B-q3_k_s.gguf new file mode 100644 index 0000000..22bf799 --- /dev/null +++ b/FableForge-1.5B-q3_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:105b66d8a4a938f3b7f7a64ffc5da1cac8acb88e96d501c0d8f7a566744bafa9 +size 760941856 diff --git a/FableForge-1.5B-q4_1.gguf b/FableForge-1.5B-q4_1.gguf new file mode 100644 index 0000000..97b3693 --- /dev/null +++ b/FableForge-1.5B-q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e1a6996a40751c4380682f9ae1345f2a7cd0f6de2202c85c73eb2a3a04b502d +size 1016839456 diff --git a/FableForge-1.5B-q4_k_s.gguf b/FableForge-1.5B-q4_k_s.gguf new file mode 100644 index 0000000..d91637e --- /dev/null +++ b/FableForge-1.5B-q4_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5ebc5b28c3cb0a4e26c75c7aa1d591260d5b1ae5c892ec26313e2ecf655745fd +size 940309792 diff --git a/FableForge-1.5B-q5_k_s.gguf b/FableForge-1.5B-q5_k_s.gguf new file mode 100644 index 0000000..ec8c455 --- /dev/null +++ b/FableForge-1.5B-q5_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:391360b3c9408598e204c3cc48d0064a530006f92a7d58eb6c358e2e9e9eaea2 +size 1098726688 diff --git a/README.md b/README.md new file mode 100644 index 0000000..306972a --- /dev/null +++ b/README.md @@ -0,0 +1,100 @@ +--- +license: apache-2.0 +language: + - en +library_name: gguf +pipeline_tag: text-generation +base_model: fableforge-ai/FableForge-1.5B +base_model_relation: quantized +tags: + - coding + - fableforge + - generalist + - gguf + - imatrix + - llama.cpp + - lm-studio + - nexus + - ollama + - reasoning + - text-generation + - uncensored +--- +# FableForge-1.5B-GGUF + +> **FableForge generalist โ€” all NEXUS domains distilled into one model.** + +[![Downloads](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhuggingface.co%2Fapi%2Fmodels%2Ffableforge-ai%2FFableForge-1.5B-GGUF&query=downloads&label=downloads&color=blue)](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF) [![Demos](https://img.shields.io/badge/๐Ÿค—-Live%20Demos-orange)](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) + +Base model: [fableforge-ai/FableForge-1.5B](https://huggingface.co/fableforge-ai/FableForge-1.5B) ยท Part of the **FableForge** ecosystem. + +--- + +## โšก Quickest start โ€” Ollama (these pulls credit the source, not a mirror) + +```bash +ollama run hf.co/fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M +``` + +## ๐Ÿฆ™ llama.cpp + +```bash +llama-cli -hf fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M -p "Hello!" +``` + +## ๐Ÿ’  LM Studio +Search **`fableforge-ai/FableForge-1.5B-GGUF`** and pick a quant below. + +--- + +## ๐Ÿ“ฆ Provided quants (download one file, not the whole repo) + +| File | Quant | Size | Notes | +| ---- | ----- | ---- | ----- | +| [FableForge-1.5B-F16.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-F16.gguf) | `F16` | 3.09 GB | Full precision (unquantized). Reference / conversion. | +| [FableForge-1.5B-Q8_0.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q8_0.gguf) | `Q8_0` | 1.65 GB | Extremely high quality โ€” usually overkill. | +| [FableForge-1.5B-Q6_K.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q6_K.gguf) | `Q6_K` | 1.33 GB | Very high quality, near-perfect. **Recommended** if you have the RAM. | +| [FableForge-1.5B-Q5_K_M.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q5_K_M.gguf) | `Q5_K_M` | 1.21 GB | High quality. **Recommended.** | +| [FableForge-1.5B-Q4_K_M.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q4_K_M.gguf) | `Q4_K_M` | 1.06 GB | โญ **Best size/quality balance โ€” default pick for most users.** | +| [FableForge-1.5B-IQ4_XS.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ4_XS.gguf) | `IQ4_XS` | 0.90 GB | imatrix โ€” great quality, smaller than Q4_K_S. **Recommended for low RAM.** | +| [FableForge-1.5B-Q4_0.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q4_0.gguf) | `Q4_0` | 0.99 GB | Legacy format โ€” prefer Q4_K_M. | +| [FableForge-1.5B-Q3_K_M.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q3_K_M.gguf) | `Q3_K_M` | 0.91 GB | Lower quality; usable when RAM is tight. | +| [FableForge-1.5B-IQ3_XXS.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ3_XXS.gguf) | `IQ3_XXS` | 0.67 GB | imatrix very low quality. | +| [FableForge-1.5B-Q2_K.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q2_K.gguf) | `Q2_K` | 0.68 GB | Very low quality โ€” surprisingly usable. | +| [FableForge-1.5B-IQ2_XXS.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ2_XXS.gguf) | `IQ2_XXS` | 0.51 GB | Tiny imatrix โ€” last resort. | +| [FableForge-1.5B-IQ1_S.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ1_S.gguf) | `?` | 0.44 GB | | +| [FableForge-1.5B-imatrix.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-imatrix.gguf) | `?` | 0.00 GB | | + +**Not sure?** Take **`Q4_K_M`**. Low RAM โ†’ **`IQ4_XS`**. Max quality โ†’ **`Q6_K`**. + +## ๐Ÿง  Prompt format (ChatML) + +``` +<|im_start|>system +{system_prompt}<|im_end|> +<|im_start|>user +{prompt}<|im_end|> +<|im_start|>assistant +``` + +## ๐ŸŒŒ See it live โ€” the FableForge demos + +This family powers a galaxy of free, interactive HF Spaces: + +- ๐Ÿงญ [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) +- ๐Ÿบ [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc) +- ๐ŸŽญ [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator) +- ๐Ÿ’ป [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal) +- ๐Ÿ‘ป [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer) + + +--- + +## ๐Ÿ”— Related models + +- ๐Ÿง  Base model (safetensors): [`FableForge-1.5B`](https://huggingface.co/fableforge-ai/FableForge-1.5B) +- ๐Ÿ”„ V2 GGUF: [`FableForge-1.5B-v2-GGUF`](https://huggingface.co/fableforge-ai/FableForge-1.5B-v2-GGUF) + +--- + +*โญ Like & share โ€” it helps people find the source instead of a mirror.* \ No newline at end of file