初始化项目,由ModelHub XC社区提供模型
Model: ghostai1/NewYears1.5b Source: Original Platform
This commit is contained in:
43
.gitattributes
vendored
Normal file
43
.gitattributes
vendored
Normal file
@@ -0,0 +1,43 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.TQ1_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
newyears1-5b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
105
README.md
Normal file
105
README.md
Normal file
@@ -0,0 +1,105 @@
|
|||||||
|
---
|
||||||
|
license: mit
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- llama.cpp
|
||||||
|
- qwen
|
||||||
|
- qwen2.5
|
||||||
|
- instruct
|
||||||
|
- lora
|
||||||
|
- roleplay
|
||||||
|
- holiday
|
||||||
|
- storytelling
|
||||||
|
- local-inference
|
||||||
|
- quantization
|
||||||
|
- ggml
|
||||||
|
- llm
|
||||||
|
---
|
||||||
|
|
||||||
|
# New Years 1.5B (GGUF)
|
||||||
|
|
||||||
|
[](LICENSE)
|
||||||
|
[](#quantized-files)
|
||||||
|
[](https://github.com/ggerganov/llama.cpp)
|
||||||
|
[](#model-details)
|
||||||
|
[](https://huggingface.co/ghostai1/NewYears-1_5b)
|
||||||
|
[](https://www.linkedin.com/in/ccengineering/)
|
||||||
|
|
||||||
|
**New Years 1.5B** is a compact seasonal model fine-tuned for **festive, upbeat, and cozy** text generation.
|
||||||
|
This repository provides **GGUF** builds optimized for **local inference** using the **llama.cpp** ecosystem and compatible runtimes.
|
||||||
|
|
||||||
|
**Quick links**
|
||||||
|
- Model: https://huggingface.co/ghostai1/NewYears-1_5b
|
||||||
|
- Runtime: https://github.com/ggerganov/llama.cpp
|
||||||
|
- Author (LinkedIn): https://www.linkedin.com/in/ccengineering/
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Overview
|
||||||
|
|
||||||
|
This is a **tone/personality-focused** model. It emphasizes celebration, warmth, and “new beginnings” vibe rather than deep reasoning or strict technical accuracy.
|
||||||
|
|
||||||
|
Recommended for:
|
||||||
|
- Creative writing and short stories
|
||||||
|
- New Year / winter-themed roleplay
|
||||||
|
- Light conversational assistants
|
||||||
|
- Local demos and low-resource systems
|
||||||
|
|
||||||
|
Not optimized for:
|
||||||
|
- Complex reasoning
|
||||||
|
- Factual retrieval
|
||||||
|
- Long-horizon planning
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Model Details
|
||||||
|
|
||||||
|
- **Model name:** New Years 1.5B
|
||||||
|
- **Base model:** Qwen2.5-1.5B-Instruct
|
||||||
|
- **Fine-tuning:** LoRA (merged)
|
||||||
|
- **Parameters:** ~1.5B
|
||||||
|
- **Format:** GGUF (llama.cpp compatible)
|
||||||
|
- **Language:** English
|
||||||
|
- **License:** MIT (base model license applies)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Quantized Files
|
||||||
|
|
||||||
|
All files are produced from the same merged model and differ only in quantization.
|
||||||
|
|
||||||
|
| File | Quantization | Approx. Size |
|
||||||
|
|---|---|---:|
|
||||||
|
| `newyears1-5b.TQ1_0.gguf` | TQ1_0 | ~0.35 GB |
|
||||||
|
| `newyears1-5b.Q2_K.gguf` | Q2_K | ~0.52 GB |
|
||||||
|
| `newyears1-5b.Q3_K_S.gguf` | Q3_K_S | ~0.60 GB |
|
||||||
|
| `newyears1-5b.Q3_K_M.gguf` | Q3_K_M | ~0.65 GB |
|
||||||
|
| `newyears1-5b.Q4_K_S.gguf` | Q4_K_S | ~0.75 GB |
|
||||||
|
| `newyears1-5b.Q4_K_M.gguf` | Q4_K_M | ~0.80 GB |
|
||||||
|
| `newyears1-5b.Q5_K_S.gguf` | Q5_K_S | ~0.90 GB |
|
||||||
|
| `newyears1-5b.Q5_K_M.gguf` | Q5_K_M | ~0.94 GB |
|
||||||
|
| `newyears1-5b.Q6_K.gguf` | Q6_K | ~1.05 GB |
|
||||||
|
| `newyears1-5b.Q8_0.gguf` | Q8_0 | ~1.35 GB |
|
||||||
|
|
||||||
|
### Recommendations
|
||||||
|
|
||||||
|
- **Default (balanced):** `Q4_K_M`
|
||||||
|
- **Higher quality:** `Q5_K_M`, `Q6_K`, `Q8_0`
|
||||||
|
- **Low RAM systems:** `Q3_K_M`, `Q2_K`
|
||||||
|
- **Ultra-low memory (experimental):** `TQ1_0`
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Usage (llama.cpp)
|
||||||
|
|
||||||
|
### CPU-only
|
||||||
|
|
||||||
|
```bash
|
||||||
|
./llama-cli \
|
||||||
|
-m newyears1-5b.Q4_K_M.gguf \
|
||||||
|
-ngl 0 \
|
||||||
|
-c 4096 \
|
||||||
|
-p "Write a cozy New Year's Eve story set in a snowy small town, full of hope and new beginnings."
|
||||||
3
newyears1-5b.Q2_K.gguf
Normal file
3
newyears1-5b.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c734d28263f6a38949aee1bdceb4f9646fd8dcc05f1fe4fa8fe613cabd7bf42c
|
||||||
|
size 676304384
|
||||||
3
newyears1-5b.Q3_K_M.gguf
Normal file
3
newyears1-5b.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0189b1727385c9662b7c88d73e8b8d762669a9b1f63fa388110a706f2c15b4cc
|
||||||
|
size 824178176
|
||||||
3
newyears1-5b.Q3_K_S.gguf
Normal file
3
newyears1-5b.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:46e15b18f2420b8f95c62c6949893a757c413326f46614fc4c95654f32231b3e
|
||||||
|
size 760944128
|
||||||
3
newyears1-5b.Q5_K_M.gguf
Normal file
3
newyears1-5b.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2b0c21c8d0f8bb60266337dd6a9a0c26f2cf46ddfb8269244326ec1ec05ca59c
|
||||||
|
size 1125049856
|
||||||
3
newyears1-5b.Q5_K_S.gguf
Normal file
3
newyears1-5b.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:aef48ac2ce046b7f42d37137cfa38e15334db7eecf1277a72a370ea9f7d952b5
|
||||||
|
size 1098728960
|
||||||
3
newyears1-5b.Q6_K.gguf
Normal file
3
newyears1-5b.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ee9750eb8556c9ce5779b40cb5c9d64fbafa63b683673a2129dae67d27247b00
|
||||||
|
size 1272739328
|
||||||
3
newyears1-5b.Q8_0.gguf
Normal file
3
newyears1-5b.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ed6ebc0b46de079eb603238bd30ac2a3ff1cb4a3678d21ae8a14ff2c64f6e0f1
|
||||||
|
size 1646572544
|
||||||
3
newyears1-5b.TQ1_0.gguf
Normal file
3
newyears1-5b.TQ1_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f4ab6c90012bb0544e5ff00ef7d34bbb751a3777a2d4ad58999e3368a1670289
|
||||||
|
size 474338816
|
||||||
Reference in New Issue
Block a user