初始化项目,由ModelHub XC社区提供模型

Model: sasa2000/Marco-Nano-Instruct-REAP-6B-A0.6B
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-28 17:13:52 +08:00
commit 5be39aeba1
17 changed files with 166843 additions and 0 deletions

38
README.md Normal file
View File

@@ -0,0 +1,38 @@
---
license: apache-2.0
base_model: ATH-MaaS/Marco-Nano-Instruct
library_name: transformers
pipeline_tag: text-generation
tags:
- reap
- pruning
- qwen3_moe
- moe
- safetensors
---
# Marco-Nano-Instruct REAP Pruned 0.25
This is a pruned derivative of `ATH-MaaS/Marco-Nano-Instruct`, produced with
`CerebrasResearch/reap` layerwise REAP pruning in a Codex-assisted experiment
(GPT5.5 xhigh based).
## Details
- Pruning method: REAP layerwise pruning
- Requested compression ratio: `0.25`
- Experts retained: `174`
- Experts per token: `8`
- Calibration dataset: `theblackcat102/evol-codealpaca-v1`
- `model_max_length`: `2048`
- `batches_per_category`: `128`
- `batch_size`: `1`
- `batch_group_size`: `8`
- Format: safetensors
## Notes
This checkpoint was created for a low-resource pruning experiment on a 6GB VRAM
environment. Benchmark evaluation was not run. A short prompt smoke check showed
usable English output, but Japanese and Chinese outputs may still show
repetition, self-continuation, or wording artifacts.