From 0090ba03ccdfdd736ed72e894d56512c642cf6ef Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Sun, 13 Sep 2026 10:36:16 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: ghostai1/NewYears1.5b Source: Original Platform --- .gitattributes | 43 ++++++++++++++++ README.md | 105 +++++++++++++++++++++++++++++++++++++++ newyears1-5b.Q2_K.gguf | 3 ++ newyears1-5b.Q3_K_M.gguf | 3 ++ newyears1-5b.Q3_K_S.gguf | 3 ++ newyears1-5b.Q5_K_M.gguf | 3 ++ newyears1-5b.Q5_K_S.gguf | 3 ++ newyears1-5b.Q6_K.gguf | 3 ++ newyears1-5b.Q8_0.gguf | 3 ++ newyears1-5b.TQ1_0.gguf | 3 ++ 10 files changed, 172 insertions(+) create mode 100644 .gitattributes create mode 100644 README.md create mode 100644 newyears1-5b.Q2_K.gguf create mode 100644 newyears1-5b.Q3_K_M.gguf create mode 100644 newyears1-5b.Q3_K_S.gguf create mode 100644 newyears1-5b.Q5_K_M.gguf create mode 100644 newyears1-5b.Q5_K_S.gguf create mode 100644 newyears1-5b.Q6_K.gguf create mode 100644 newyears1-5b.Q8_0.gguf create mode 100644 newyears1-5b.TQ1_0.gguf diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..8941e2b --- /dev/null +++ b/.gitattributes @@ -0,0 +1,43 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +newyears1-5b.TQ1_0.gguf filter=lfs diff=lfs merge=lfs -text +newyears1-5b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +newyears1-5b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +newyears1-5b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +newyears1-5b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +newyears1-5b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +newyears1-5b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +newyears1-5b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..4e4e9be --- /dev/null +++ b/README.md @@ -0,0 +1,105 @@ +--- +license: mit +language: +- en +pipeline_tag: text-generation +tags: +- gguf +- llama.cpp +- qwen +- qwen2.5 +- instruct +- lora +- roleplay +- holiday +- storytelling +- local-inference +- quantization +- ggml +- llm +--- + +# New Years 1.5B (GGUF) + +[![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE) +[![Format: GGUF](https://img.shields.io/badge/Format-GGUF-orange)](#quantized-files) +[![Runtime: llama.cpp](https://img.shields.io/badge/Runtime-llama.cpp-purple)](https://github.com/ggerganov/llama.cpp) +[![Base: Qwen2.5-1.5B-Instruct](https://img.shields.io/badge/Base-Qwen2.5--1.5B--Instruct-lightgrey)](#model-details) +[![Hugging Face](https://img.shields.io/badge/Hugging%20Face-Model-yellow)](https://huggingface.co/ghostai1/NewYears-1_5b) +[![LinkedIn](https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?logo=linkedin&logoColor=white)](https://www.linkedin.com/in/ccengineering/) + +**New Years 1.5B** is a compact seasonal model fine-tuned for **festive, upbeat, and cozy** text generation. +This repository provides **GGUF** builds optimized for **local inference** using the **llama.cpp** ecosystem and compatible runtimes. + +**Quick links** +- Model: https://huggingface.co/ghostai1/NewYears-1_5b +- Runtime: https://github.com/ggerganov/llama.cpp +- Author (LinkedIn): https://www.linkedin.com/in/ccengineering/ + +--- + +## Overview + +This is a **tone/personality-focused** model. It emphasizes celebration, warmth, and “new beginnings” vibe rather than deep reasoning or strict technical accuracy. + +Recommended for: +- Creative writing and short stories +- New Year / winter-themed roleplay +- Light conversational assistants +- Local demos and low-resource systems + +Not optimized for: +- Complex reasoning +- Factual retrieval +- Long-horizon planning + +--- + +## Model Details + +- **Model name:** New Years 1.5B +- **Base model:** Qwen2.5-1.5B-Instruct +- **Fine-tuning:** LoRA (merged) +- **Parameters:** ~1.5B +- **Format:** GGUF (llama.cpp compatible) +- **Language:** English +- **License:** MIT (base model license applies) + +--- + +## Quantized Files + +All files are produced from the same merged model and differ only in quantization. + +| File | Quantization | Approx. Size | +|---|---|---:| +| `newyears1-5b.TQ1_0.gguf` | TQ1_0 | ~0.35 GB | +| `newyears1-5b.Q2_K.gguf` | Q2_K | ~0.52 GB | +| `newyears1-5b.Q3_K_S.gguf` | Q3_K_S | ~0.60 GB | +| `newyears1-5b.Q3_K_M.gguf` | Q3_K_M | ~0.65 GB | +| `newyears1-5b.Q4_K_S.gguf` | Q4_K_S | ~0.75 GB | +| `newyears1-5b.Q4_K_M.gguf` | Q4_K_M | ~0.80 GB | +| `newyears1-5b.Q5_K_S.gguf` | Q5_K_S | ~0.90 GB | +| `newyears1-5b.Q5_K_M.gguf` | Q5_K_M | ~0.94 GB | +| `newyears1-5b.Q6_K.gguf` | Q6_K | ~1.05 GB | +| `newyears1-5b.Q8_0.gguf` | Q8_0 | ~1.35 GB | + +### Recommendations + +- **Default (balanced):** `Q4_K_M` +- **Higher quality:** `Q5_K_M`, `Q6_K`, `Q8_0` +- **Low RAM systems:** `Q3_K_M`, `Q2_K` +- **Ultra-low memory (experimental):** `TQ1_0` + +--- + +## Usage (llama.cpp) + +### CPU-only + +```bash +./llama-cli \ + -m newyears1-5b.Q4_K_M.gguf \ + -ngl 0 \ + -c 4096 \ + -p "Write a cozy New Year's Eve story set in a snowy small town, full of hope and new beginnings." diff --git a/newyears1-5b.Q2_K.gguf b/newyears1-5b.Q2_K.gguf new file mode 100644 index 0000000..0c33db6 --- /dev/null +++ b/newyears1-5b.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c734d28263f6a38949aee1bdceb4f9646fd8dcc05f1fe4fa8fe613cabd7bf42c +size 676304384 diff --git a/newyears1-5b.Q3_K_M.gguf b/newyears1-5b.Q3_K_M.gguf new file mode 100644 index 0000000..57fdf58 --- /dev/null +++ b/newyears1-5b.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0189b1727385c9662b7c88d73e8b8d762669a9b1f63fa388110a706f2c15b4cc +size 824178176 diff --git a/newyears1-5b.Q3_K_S.gguf b/newyears1-5b.Q3_K_S.gguf new file mode 100644 index 0000000..96c3800 --- /dev/null +++ b/newyears1-5b.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46e15b18f2420b8f95c62c6949893a757c413326f46614fc4c95654f32231b3e +size 760944128 diff --git a/newyears1-5b.Q5_K_M.gguf b/newyears1-5b.Q5_K_M.gguf new file mode 100644 index 0000000..fadf39b --- /dev/null +++ b/newyears1-5b.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b0c21c8d0f8bb60266337dd6a9a0c26f2cf46ddfb8269244326ec1ec05ca59c +size 1125049856 diff --git a/newyears1-5b.Q5_K_S.gguf b/newyears1-5b.Q5_K_S.gguf new file mode 100644 index 0000000..00146fb --- /dev/null +++ b/newyears1-5b.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aef48ac2ce046b7f42d37137cfa38e15334db7eecf1277a72a370ea9f7d952b5 +size 1098728960 diff --git a/newyears1-5b.Q6_K.gguf b/newyears1-5b.Q6_K.gguf new file mode 100644 index 0000000..5d5f2a9 --- /dev/null +++ b/newyears1-5b.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee9750eb8556c9ce5779b40cb5c9d64fbafa63b683673a2129dae67d27247b00 +size 1272739328 diff --git a/newyears1-5b.Q8_0.gguf b/newyears1-5b.Q8_0.gguf new file mode 100644 index 0000000..d1a7558 --- /dev/null +++ b/newyears1-5b.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ed6ebc0b46de079eb603238bd30ac2a3ff1cb4a3678d21ae8a14ff2c64f6e0f1 +size 1646572544 diff --git a/newyears1-5b.TQ1_0.gguf b/newyears1-5b.TQ1_0.gguf new file mode 100644 index 0000000..ae41d24 --- /dev/null +++ b/newyears1-5b.TQ1_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f4ab6c90012bb0544e5ff00ef7d34bbb751a3777a2d4ad58999e3368a1670289 +size 474338816