commit 8bb5de8c1de6bfb04bb172f58e4f0d32082694f5 Author: ModelHub XC Date: Mon Aug 17 15:51:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: Spadav/emma-5-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..c07ed23 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,36 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +emma-5-f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..ed9cb9f --- /dev/null +++ b/README.md @@ -0,0 +1,114 @@ +--- +license: openrail +language: + - it +tags: + - gguf + - italian + - text-generation + - emma-5 +base_model: eldavoo/emma-5 +--- + +# Emma-5 GGUF + +Unofficial GGUF conversion of [eldavoo/emma-5](https://huggingface.co/eldavoo/emma-5), archived from the original Egomnia Emma-5 release. + +The conversion was validated by reconstructing the ONNX attention graph in PyTorch and comparing logits against the original ONNX Runtime output before exporting to GGUF. + +The original ONNX model remains the reference runtime. This GGUF is intended for raw llama.cpp completion use, not chat-template frontends. + +## Files + +| File | Description | +|------|-------------| +| `emma-5-f16.gguf` | FP16 GGUF, ~1.2 GB | + +## Conversion Details + +The original model is distributed as ONNX only. Direct conversion to GGUF required matching the exported attention graph exactly. + +Pipeline summary: + +1. ONNX weights and rotary constants were loaded. +2. The exported attention graph was matched in PyTorch for validation. +3. Logit parity was checked against ONNX Runtime. +4. Q/K rows were permuted from split-half RoPE layout to llama.cpp interleaved layout. +5. The model was exported as FP16 GGUF with `rms_norm_eps=1e-6`. + +Validation result: + +```text +max absolute logit error: ~4e-5 +``` + +## Architecture + +| Parameter | Value | +|-----------|-------| +| Parameters | ~550M | +| Layers | 28 | +| Hidden size | 1280 | +| Q heads | 16 | +| KV heads | 4 | +| Head dim | 80 | +| GQA ratio | 4:1 | +| FFN | SwiGLU | +| Context | 2048 | +| Vocab | 50000 | +| RoPE theta | 10000 | +| Embeddings | Tied | + +## Prompt Format + +Use a single-line Italian instruction format: + +```text +### Istruzione: Qual e la capitale d Italia? ### Risposta: +``` + +Use raw completion mode only. + +Do **not** use ChatML, Llama 3 chat templates, OpenAI-style messages, or frontend "conversation" wrappers. In particular, prompts containing markers like `<|im_start|>` or `<|im_end|>` are not supported and may cause repeated marker output. + +Avoid multiline templates in llama.cpp. The original ONNX SentencePiece path normalizes whitespace differently, while llama.cpp may preserve newline tokens. + +For the most faithful behavior, compare against or use the original ONNX Runtime model. + +## Example + +```bash +./llama-cli \ + -m emma-5-f16.gguf \ + --no-conversation \ + -p "### Istruzione: Qual e la capitale d Italia? ### Risposta:" \ + -n 64 \ + --temp 0.7 \ + --repeat-penalty 1.2 +``` + +Expected style: + +```text +La capitale d'Italia è Roma... +``` + +## Quantization + +This repo provides the FP16 GGUF. Other quantizations can be generated with llama.cpp: + +```bash +./llama-quantize emma-5-f16.gguf emma-5-Q4_K_M.gguf Q4_K_M +``` + +## Compatibility + +Converted and smoke-tested with a recent llama.cpp build. + +## Credits + +- Original model by [Egomnia S.p.A.](https://www.egomnia.com) +- Archived by [eldavoo](https://huggingface.co/eldavoo/emma-5) +- GGUF conversion by [Spadav](https://github.com/Spadav) + +This is an unofficial conversion. diff --git a/emma-5-f16.gguf b/emma-5-f16.gguf new file mode 100644 index 0000000..2fbe7f6 --- /dev/null +++ b/emma-5-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93f4a105c901704d452a87b95bdbe8376cedc28986c23dcf0d004ed0ff4a0690 +size 1230035008