初始化项目,由ModelHub XC社区提供模型
Model: fableforge-ai/FableForge-1.5B-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-iq2_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-iq2_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-iq3_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-iq3_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-iq3_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-iq4_nl.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
FableForge-1.5B-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
FableForge-1.5B-F16.gguf
Normal file
3
FableForge-1.5B-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ae6d277832358dd5732a377c35482f51b967c5b02ad47908b2d73fd8c1a0dca1
|
||||
size 3093666592
|
||||
3
FableForge-1.5B-IQ1_S.gguf
Normal file
3
FableForge-1.5B-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7e1d779d4e80c9dcb537556305be9a73aed33be0bb3de1317fd8f819d7eaed10
|
||||
size 436525088
|
||||
3
FableForge-1.5B-IQ2_XXS.gguf
Normal file
3
FableForge-1.5B-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e093979ddb1e17eb85c2558941f15746fe21dc4584715e679e4deb460b6a3eea
|
||||
size 511014976
|
||||
3
FableForge-1.5B-IQ3_XXS.gguf
Normal file
3
FableForge-1.5B-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5b8e6af0130102f3fdb39a0dff7ee6b46cc8c5be858f7364fc88d188c331a71e
|
||||
size 668789824
|
||||
3
FableForge-1.5B-IQ4_XS.gguf
Normal file
3
FableForge-1.5B-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d92707dd3f561f55fcbd0962830ac3f310ad18925aa918d163895c857c3824a6
|
||||
size 895729216
|
||||
3
FableForge-1.5B-Q2_K.gguf
Normal file
3
FableForge-1.5B-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b9f65b78aad7e85b0387a63da12a9ea60b2c23b83016da89e3524f7b1c24105a
|
||||
size 676302112
|
||||
3
FableForge-1.5B-Q3_K_M.gguf
Normal file
3
FableForge-1.5B-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:09cac974bd3d4bdef28e208becd50351d4700c35b9e3420821ee0bbedf2ab043
|
||||
size 911428672
|
||||
3
FableForge-1.5B-Q4_0.gguf
Normal file
3
FableForge-1.5B-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:484968a8c4e1a3e304dcd5d5a08593c3b771dd71abde0be7b386dc85eb06aab0
|
||||
size 991472416
|
||||
3
FableForge-1.5B-Q4_K_M.gguf
Normal file
3
FableForge-1.5B-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ba01779e339d8cb551b7d8399ff02d8028558b93abc9e97ec87e80ec5c834af5
|
||||
size 1057348672
|
||||
3
FableForge-1.5B-Q5_K_M.gguf
Normal file
3
FableForge-1.5B-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:881fd73e88a81d0202918271bc76aef6bbe04a7a78ccc74efabd6901b27c74b4
|
||||
size 1207262272
|
||||
3
FableForge-1.5B-Q6_K.gguf
Normal file
3
FableForge-1.5B-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7bd3a03698eb89b7398a933761bf07954aaa1c6572ed69ec4c6644ad8836c926
|
||||
size 1329257536
|
||||
3
FableForge-1.5B-Q8_0.gguf
Normal file
3
FableForge-1.5B-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6b1957988cbea7c391fae39aa232d147874df8f921cf6143b0164b137b098ef3
|
||||
size 1646570272
|
||||
3
FableForge-1.5B-imatrix.dat
Normal file
3
FableForge-1.5B-imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:eed3a55cccc7f15eedbdfb1d33ed103ad27abdf5f0366e62579707bfbe0a8e61
|
||||
size 2065920
|
||||
3
FableForge-1.5B-imatrix.gguf
Normal file
3
FableForge-1.5B-imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:eed3a55cccc7f15eedbdfb1d33ed103ad27abdf5f0366e62579707bfbe0a8e61
|
||||
size 2065920
|
||||
3
FableForge-1.5B-iq2_s.gguf
Normal file
3
FableForge-1.5B-iq2_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e05a571fdf63ff02b79b55dd7bdfceaed01b25bf4bd5c11c2648e84e46fb6d06
|
||||
size 563807264
|
||||
3
FableForge-1.5B-iq2_xs.gguf
Normal file
3
FableForge-1.5B-iq2_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4d6afade86e8a881b0994b33f30b1fd249ffa32585bc6d75d99e74972e0edb74
|
||||
size 550324256
|
||||
3
FableForge-1.5B-iq3_m.gguf
Normal file
3
FableForge-1.5B-iq3_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a1f25b283895c34125217961edd2c760b9dd5dd17681aad67f6fbbec368a14c6
|
||||
size 776661536
|
||||
3
FableForge-1.5B-iq3_s.gguf
Normal file
3
FableForge-1.5B-iq3_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:060f34eb473f7d544b0d26653a516dd07086e660c327a58fa4fed42abb95ceb6
|
||||
size 762404384
|
||||
3
FableForge-1.5B-iq3_xs.gguf
Normal file
3
FableForge-1.5B-iq3_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:65e9b87f937feba9a07766ebf6c680c4267f80af7d848c65b48c2148fdffd8a6
|
||||
size 731696672
|
||||
3
FableForge-1.5B-iq4_nl.gguf
Normal file
3
FableForge-1.5B-iq4_nl.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fd7fce0a3fe571020e6cdd5207aa76a529165bdb2bb359ad21e36cb47e201b35
|
||||
size 936328736
|
||||
3
FableForge-1.5B-q3_k_l.gguf
Normal file
3
FableForge-1.5B-q3_k_l.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6870da02f5fe4cbb828103a3e4c5bc8f5ba530c1c999a2812fc375c03fbb2cff
|
||||
size 880160032
|
||||
3
FableForge-1.5B-q3_k_s.gguf
Normal file
3
FableForge-1.5B-q3_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:105b66d8a4a938f3b7f7a64ffc5da1cac8acb88e96d501c0d8f7a566744bafa9
|
||||
size 760941856
|
||||
3
FableForge-1.5B-q4_1.gguf
Normal file
3
FableForge-1.5B-q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8e1a6996a40751c4380682f9ae1345f2a7cd0f6de2202c85c73eb2a3a04b502d
|
||||
size 1016839456
|
||||
3
FableForge-1.5B-q4_k_s.gguf
Normal file
3
FableForge-1.5B-q4_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5ebc5b28c3cb0a4e26c75c7aa1d591260d5b1ae5c892ec26313e2ecf655745fd
|
||||
size 940309792
|
||||
3
FableForge-1.5B-q5_k_s.gguf
Normal file
3
FableForge-1.5B-q5_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:391360b3c9408598e204c3cc48d0064a530006f92a7d58eb6c358e2e9e9eaea2
|
||||
size 1098726688
|
||||
100
README.md
Normal file
100
README.md
Normal file
@@ -0,0 +1,100 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
library_name: gguf
|
||||
pipeline_tag: text-generation
|
||||
base_model: fableforge-ai/FableForge-1.5B
|
||||
base_model_relation: quantized
|
||||
tags:
|
||||
- coding
|
||||
- fableforge
|
||||
- generalist
|
||||
- gguf
|
||||
- imatrix
|
||||
- llama.cpp
|
||||
- lm-studio
|
||||
- nexus
|
||||
- ollama
|
||||
- reasoning
|
||||
- text-generation
|
||||
- uncensored
|
||||
---
|
||||
# FableForge-1.5B-GGUF
|
||||
|
||||
> **FableForge generalist — all NEXUS domains distilled into one model.**
|
||||
|
||||
[](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF) [](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
||||
|
||||
Base model: [fableforge-ai/FableForge-1.5B](https://huggingface.co/fableforge-ai/FableForge-1.5B) · Part of the **FableForge** ecosystem.
|
||||
|
||||
---
|
||||
|
||||
## ⚡ Quickest start — Ollama (these pulls credit the source, not a mirror)
|
||||
|
||||
```bash
|
||||
ollama run hf.co/fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M
|
||||
```
|
||||
|
||||
## 🦙 llama.cpp
|
||||
|
||||
```bash
|
||||
llama-cli -hf fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M -p "Hello!"
|
||||
```
|
||||
|
||||
## 💠 LM Studio
|
||||
Search **`fableforge-ai/FableForge-1.5B-GGUF`** and pick a quant below.
|
||||
|
||||
---
|
||||
|
||||
## 📦 Provided quants (download one file, not the whole repo)
|
||||
|
||||
| File | Quant | Size | Notes |
|
||||
| ---- | ----- | ---- | ----- |
|
||||
| [FableForge-1.5B-F16.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-F16.gguf) | `F16` | 3.09 GB | Full precision (unquantized). Reference / conversion. |
|
||||
| [FableForge-1.5B-Q8_0.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q8_0.gguf) | `Q8_0` | 1.65 GB | Extremely high quality — usually overkill. |
|
||||
| [FableForge-1.5B-Q6_K.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q6_K.gguf) | `Q6_K` | 1.33 GB | Very high quality, near-perfect. **Recommended** if you have the RAM. |
|
||||
| [FableForge-1.5B-Q5_K_M.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q5_K_M.gguf) | `Q5_K_M` | 1.21 GB | High quality. **Recommended.** |
|
||||
| [FableForge-1.5B-Q4_K_M.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q4_K_M.gguf) | `Q4_K_M` | 1.06 GB | ⭐ **Best size/quality balance — default pick for most users.** |
|
||||
| [FableForge-1.5B-IQ4_XS.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ4_XS.gguf) | `IQ4_XS` | 0.90 GB | imatrix — great quality, smaller than Q4_K_S. **Recommended for low RAM.** |
|
||||
| [FableForge-1.5B-Q4_0.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q4_0.gguf) | `Q4_0` | 0.99 GB | Legacy format — prefer Q4_K_M. |
|
||||
| [FableForge-1.5B-Q3_K_M.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q3_K_M.gguf) | `Q3_K_M` | 0.91 GB | Lower quality; usable when RAM is tight. |
|
||||
| [FableForge-1.5B-IQ3_XXS.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ3_XXS.gguf) | `IQ3_XXS` | 0.67 GB | imatrix very low quality. |
|
||||
| [FableForge-1.5B-Q2_K.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-Q2_K.gguf) | `Q2_K` | 0.68 GB | Very low quality — surprisingly usable. |
|
||||
| [FableForge-1.5B-IQ2_XXS.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ2_XXS.gguf) | `IQ2_XXS` | 0.51 GB | Tiny imatrix — last resort. |
|
||||
| [FableForge-1.5B-IQ1_S.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-IQ1_S.gguf) | `?` | 0.44 GB | |
|
||||
| [FableForge-1.5B-imatrix.gguf](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF/blob/main/FableForge-1.5B-imatrix.gguf) | `?` | 0.00 GB | |
|
||||
|
||||
**Not sure?** Take **`Q4_K_M`**. Low RAM → **`IQ4_XS`**. Max quality → **`Q6_K`**.
|
||||
|
||||
## 🧠 Prompt format (ChatML)
|
||||
|
||||
```
|
||||
<|im_start|>system
|
||||
{system_prompt}<|im_end|>
|
||||
<|im_start|>user
|
||||
{prompt}<|im_end|>
|
||||
<|im_start|>assistant
|
||||
```
|
||||
|
||||
## 🌌 See it live — the FableForge demos
|
||||
|
||||
This family powers a galaxy of free, interactive HF Spaces:
|
||||
|
||||
- 🧭 [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
||||
- 🍺 [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc)
|
||||
- 🎭 [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator)
|
||||
- 💻 [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal)
|
||||
- 👻 [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer)
|
||||
|
||||
|
||||
---
|
||||
|
||||
## 🔗 Related models
|
||||
|
||||
- 🧠 Base model (safetensors): [`FableForge-1.5B`](https://huggingface.co/fableforge-ai/FableForge-1.5B)
|
||||
- 🔄 V2 GGUF: [`FableForge-1.5B-v2-GGUF`](https://huggingface.co/fableforge-ai/FableForge-1.5B-v2-GGUF)
|
||||
|
||||
---
|
||||
|
||||
*⭐ Like & share — it helps people find the source instead of a mirror.*
|
||||
Reference in New Issue
Block a user