初始化项目,由ModelHub XC社区提供模型
Model: fableforge-ai/FableForge-1.5B-v2-GGUF Source: Original Platform
This commit is contained in:
70
README.md
Normal file
70
README.md
Normal file
@@ -0,0 +1,70 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
library_name: gguf
|
||||
base_model: King3Djbl/FableForge-1.5B-v2
|
||||
base_model_relation: quantized
|
||||
tags:
|
||||
- gguf
|
||||
- fableforge
|
||||
- 1.5b
|
||||
- llama.cpp
|
||||
- lm-studio
|
||||
- ollama
|
||||
- text-generation
|
||||
- uncensored
|
||||
- continued-pretraining
|
||||
- imatrix
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# FableForge-1.5B-v2-GGUF
|
||||
|
||||
GGUF quantizations of [King3Djbl/FableForge-1.5B-v2](https://huggingface.co/King3Djbl/FableForge-1.5B-v2), a 1.5B parameter model fine-tuned from FableForge-1.5B with continued pretraining for improved reasoning and tool use.
|
||||
|
||||
## Available Quants
|
||||
|
||||
| Quant | File | Size |
|
||||
|---|---|---|
|
||||
| F16 | `FableForge-1.5B-v2-f16.gguf` | 2.88 GB |
|
||||
| Q8_0 | `FableForge-1.5B-v2-q8_0.gguf` | 1.53 GB |
|
||||
| Q6_K | `FableForge-1.5B-v2-q6_k.gguf` | 1.19 GB |
|
||||
| Q5_K_M | `FableForge-1.5B-v2-q5_k_m.gguf` | 1.05 GB |
|
||||
| Q5_K_S | `FableForge-1.5B-v2-q5_k_s.gguf` | 1.02 GB |
|
||||
| Q4_K_M | `FableForge-1.5B-v2-q4_k_m.gguf` | 0.92 GB |
|
||||
| Q4_K_S | `FableForge-1.5B-v2-q4_k_s.gguf` | 0.87 GB |
|
||||
| Q4_0 | `FableForge-1.5B-v2-q4_0.gguf` | 0.87 GB |
|
||||
| Q4_1 | `FableForge-1.5B-v2-q4_1.gguf` | 0.97 GB |
|
||||
| Q3_K_L | `FableForge-1.5B-v2-q3_k_l.gguf` | 0.79 GB |
|
||||
| Q3_K_M | `FableForge-1.5B-v2-q3_k_m.gguf` | 0.77 GB |
|
||||
| Q3_K_S | `FableForge-1.5B-v2-q3_k_s.gguf` | 0.70 GB |
|
||||
| Q2_K | `FableForge-1.5B-v2-q2_k.gguf` | 0.63 GB |
|
||||
| IQ4_NL | `FableForge-1.5B-v2-iq4_nl.gguf` | 0.84 GB |
|
||||
| IQ4_XS | `FableForge-1.5B-v2-iq4_xs.gguf` | 0.83 GB |
|
||||
| IQ3_M | `FableForge-1.5B-v2-iq3_m.gguf` | 0.69 GB |
|
||||
| IQ3_S | `FableForge-1.5B-v2-iq3_s.gguf` | 0.65 GB |
|
||||
| IQ3_XS | `FableForge-1.5B-v2-iq3_xs.gguf` | 0.62 GB |
|
||||
| IQ3_XXS | `FableForge-1.5B-v2-iq3_xxs.gguf` | 0.55 GB |
|
||||
| IQ2_XS | `FableForge-1.5B-v2-iq2_xs.gguf` | 0.44 GB |
|
||||
| IQ2_S | `FableForge-1.5B-v2-iq2_s.gguf` | 0.48 GB |
|
||||
| IQ2_XXS | `FableForge-1.5B-v2-iq2_xxs.gguf` | 0.48 GB |
|
||||
| IQ1_S | `FableForge-1.5B-v2-iq1_s.gguf` | 0.41 GB |
|
||||
|
||||
## Usage
|
||||
|
||||
### llama.cpp
|
||||
```bash
|
||||
./main -m FableForge-1.5B-v2-q4_k_m.gguf -p "Hello" -n 512
|
||||
```
|
||||
|
||||
### Ollama
|
||||
```bash
|
||||
ollama run hf.co/fableforge-ai/FableForge-1.5B-v2-GGUF:Q4_K_M
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 🔗 Related models
|
||||
|
||||
- 🧠 V2 base model (safetensors): [`FableForge-1.5B-v2`](https://huggingface.co/King3Djbl/FableForge-1.5B-v2)
|
||||
- 📊 V1 GGUF: [`FableForge-1.5B-GGUF`](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF)
|
||||
Reference in New Issue
Block a user