初始化项目,由ModelHub XC社区提供模型
Model: ghostai1/Easter-Spirit2b Source: Original Platform
This commit is contained in:
105
README.md
Normal file
105
README.md
Normal file
@@ -0,0 +1,105 @@
|
||||
---
|
||||
license: mit
|
||||
language:
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- gguf
|
||||
- llama.cpp
|
||||
- qwen
|
||||
- qwen2.5
|
||||
- instruct
|
||||
- lora
|
||||
- roleplay
|
||||
- holiday
|
||||
- storytelling
|
||||
- local-inference
|
||||
- quantization
|
||||
- ggml
|
||||
- llm
|
||||
---
|
||||
|
||||
# Easter Spirit 2B (GGUF)
|
||||
|
||||
[](LICENSE)
|
||||
[](#quantized-files)
|
||||
[](https://github.com/ggerganov/llama.cpp)
|
||||
[](#model-details)
|
||||
[](https://huggingface.co/ghostai1/Easter-Spirit2b)
|
||||
[](https://www.linkedin.com/in/ccengineering/)
|
||||
|
||||
**Easter Spirit 2B** is a compact seasonal model fine-tuned for **warm, cheerful, and family-friendly** text generation.
|
||||
This repository provides **GGUF** builds optimized for **local inference** using the **llama.cpp** ecosystem and compatible runtimes.
|
||||
|
||||
**Quick links**
|
||||
- Model: https://huggingface.co/ghostai1/Easter-Spirit2b
|
||||
- Runtime: https://github.com/ggerganov/llama.cpp
|
||||
- Author (LinkedIn): https://www.linkedin.com/in/ccengineering/
|
||||
|
||||
---
|
||||
|
||||
## Overview
|
||||
|
||||
This is a **tone/personality-focused** model. It emphasizes warmth, friendliness, and seasonal flavor rather than deep reasoning or strict technical accuracy.
|
||||
|
||||
Recommended for:
|
||||
- Creative writing and short stories
|
||||
- Holiday / spring-themed roleplay
|
||||
- Light conversational assistants
|
||||
- Local demos and low-resource systems
|
||||
|
||||
Not optimized for:
|
||||
- Complex reasoning
|
||||
- Factual retrieval
|
||||
- Long-horizon planning
|
||||
|
||||
---
|
||||
|
||||
## Model Details
|
||||
|
||||
- **Model name:** Easter Spirit 2B
|
||||
- **Base model:** Qwen2.5-2B-Instruct
|
||||
- **Fine-tuning:** LoRA (merged)
|
||||
- **Parameters:** ~2B
|
||||
- **Format:** GGUF (llama.cpp compatible)
|
||||
- **Language:** English
|
||||
- **License:** MIT (base model license applies)
|
||||
|
||||
---
|
||||
|
||||
## Quantized Files
|
||||
|
||||
All files are produced from the same merged model and differ only in quantization.
|
||||
|
||||
| File | Quantization | Approx. Size |
|
||||
|---|---|---:|
|
||||
| `release_v1.TQ1_0.gguf` | TQ1_0 | ~0.47 GB |
|
||||
| `release_v1.Q2_K.gguf` | Q2_K | ~0.68 GB |
|
||||
| `release_v1.Q3_K_S.gguf` | Q3_K_S | ~0.76 GB |
|
||||
| `release_v1.Q3_K_M.gguf` | Q3_K_M | ~0.82 GB |
|
||||
| `release_v1.Q4_K_S.gguf` | Q4_K_S | ~0.94 GB |
|
||||
| `release_v1.Q4_K_M.gguf` | Q4_K_M | ~0.99 GB |
|
||||
| `release_v1.Q5_K_S.gguf` | Q5_K_S | ~1.10 GB |
|
||||
| `release_v1.Q5_K_M.gguf` | Q5_K_M | ~1.13 GB |
|
||||
| `release_v1.Q6_K.gguf` | Q6_K | ~1.27 GB |
|
||||
| `release_v1.Q8_0.gguf` | Q8_0 | ~1.65 GB |
|
||||
|
||||
### Recommendations
|
||||
|
||||
- **Default (balanced):** `Q4_K_M`
|
||||
- **Higher quality:** `Q5_K_M`, `Q6_K`, `Q8_0`
|
||||
- **Low RAM systems:** `Q3_K_M`, `Q2_K`
|
||||
- **Ultra-low memory (experimental):** `TQ1_0`
|
||||
|
||||
---
|
||||
|
||||
## Usage (llama.cpp)
|
||||
|
||||
### CPU-only
|
||||
|
||||
```bash
|
||||
./llama-cli \
|
||||
-m release_v1.Q4_K_M.gguf \
|
||||
-ngl 0 \
|
||||
-c 4096 \
|
||||
-p "Write a cozy springtime story inspired by Easter morning in a small town."
|
||||
Reference in New Issue
Block a user