初始化项目,由ModelHub XC社区提供模型

Model: sarrington/qwen2.5-0.5b-spliced
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-13 13:38:11 +08:00
commit 4dbd812386
14 changed files with 412 additions and 0 deletions

29
README.md Normal file
View File

@@ -0,0 +1,29 @@
---
language:
- en
license: apache-2.0
tags:
- qwen
- qwen2.5
- text-generation
- gguf
- local-ai
- apple-silicon
---
# Qwen 2.5 0.5B Spliced GGUF
A highly optimized, 15-layer spliced variant of the **Qwen 2.5 0.5B** architecture.
## Model Description
This repository contains the spliced mixed-precision weights of Qwen 2.5 0.5B, surgically pruned from 16 layers to 15 layers. It features standard configs and tokenizer support for seamless local execution on mobile and edge platforms.
* **Format**: Safetensors / GGUF (`Q4_K_M`, `IQ4_XS`)
* **Size**: 284 MB (GGUF) / 257 MB (IQ4_XS)
* **Target Platforms**: Apple Silicon MacBooks (M1/M2/M3/M4) and standard CPU/GPU local runtimes.
## Local Quickstart
Run the model natively via standard `llama-cli`:
```bash
llama-cli -ngl 100 -m ./gemma_spliced_fresh_q4km.gguf -p "The mathematical beauty of wavelets lies in" -n 128
```