初始化项目，由ModelHub XC社区提供模型
Model: Spadav/emma-5-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
36
.gitattributes
vendored
Normal file
36
.gitattributes
vendored
Normal file
@@ -0,0 +1,36 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
emma-5-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
114
README.md
Normal file
114
README.md
Normal file
@@ -0,0 +1,114 @@
|
||||
---
|
||||
license: openrail
|
||||
language:
|
||||
- it
|
||||
tags:
|
||||
- gguf
|
||||
- italian
|
||||
- text-generation
|
||||
- emma-5
|
||||
base_model: eldavoo/emma-5
|
||||
---
|
||||
|
||||
# Emma-5 GGUF
|
||||
|
||||
Unofficial GGUF conversion of [eldavoo/emma-5](https://huggingface.co/eldavoo/emma-5), archived from the original Egomnia Emma-5 release.
|
||||
|
||||
The conversion was validated by reconstructing the ONNX attention graph in PyTorch and comparing logits against the original ONNX Runtime output before exporting to GGUF.
|
||||
|
||||
The original ONNX model remains the reference runtime. This GGUF is intended for raw llama.cpp completion use, not chat-template frontends.
|
||||
|
||||
## Files
|
||||
|
||||
| File | Description |
|
||||
|------|-------------|
|
||||
| `emma-5-f16.gguf` | FP16 GGUF, ~1.2 GB |
|
||||
|
||||
## Conversion Details
|
||||
|
||||
The original model is distributed as ONNX only. Direct conversion to GGUF required matching the exported attention graph exactly.
|
||||
|
||||
Pipeline summary:
|
||||
|
||||
1. ONNX weights and rotary constants were loaded.
|
||||
2. The exported attention graph was matched in PyTorch for validation.
|
||||
3. Logit parity was checked against ONNX Runtime.
|
||||
4. Q/K rows were permuted from split-half RoPE layout to llama.cpp interleaved layout.
|
||||
5. The model was exported as FP16 GGUF with `rms_norm_eps=1e-6`.
|
||||
|
||||
Validation result:
|
||||
|
||||
```text
|
||||
max absolute logit error: ~4e-5
|
||||
```
|
||||
|
||||
## Architecture
|
||||
|
||||
| Parameter | Value |
|
||||
|-----------|-------|
|
||||
| Parameters | ~550M |
|
||||
| Layers | 28 |
|
||||
| Hidden size | 1280 |
|
||||
| Q heads | 16 |
|
||||
| KV heads | 4 |
|
||||
| Head dim | 80 |
|
||||
| GQA ratio | 4:1 |
|
||||
| FFN | SwiGLU |
|
||||
| Context | 2048 |
|
||||
| Vocab | 50000 |
|
||||
| RoPE theta | 10000 |
|
||||
| Embeddings | Tied |
|
||||
|
||||
## Prompt Format
|
||||
|
||||
Use a single-line Italian instruction format:
|
||||
|
||||
```text
|
||||
### Istruzione: Qual e la capitale d Italia? ### Risposta:
|
||||
```
|
||||
|
||||
Use raw completion mode only.
|
||||
|
||||
Do **not** use ChatML, Llama 3 chat templates, OpenAI-style messages, or frontend "conversation" wrappers. In particular, prompts containing markers like `<|im_start|>` or `<|im_end|>` are not supported and may cause repeated marker output.
|
||||
|
||||
Avoid multiline templates in llama.cpp. The original ONNX SentencePiece path normalizes whitespace differently, while llama.cpp may preserve newline tokens.
|
||||
|
||||
For the most faithful behavior, compare against or use the original ONNX Runtime model.
|
||||
|
||||
## Example
|
||||
|
||||
```bash
|
||||
./llama-cli \
|
||||
-m emma-5-f16.gguf \
|
||||
--no-conversation \
|
||||
-p "### Istruzione: Qual e la capitale d Italia? ### Risposta:" \
|
||||
-n 64 \
|
||||
--temp 0.7 \
|
||||
--repeat-penalty 1.2
|
||||
```
|
||||
|
||||
Expected style:
|
||||
|
||||
```text
|
||||
La capitale d'Italia è Roma...
|
||||
```
|
||||
|
||||
## Quantization
|
||||
|
||||
This repo provides the FP16 GGUF. Other quantizations can be generated with llama.cpp:
|
||||
|
||||
```bash
|
||||
./llama-quantize emma-5-f16.gguf emma-5-Q4_K_M.gguf Q4_K_M
|
||||
```
|
||||
|
||||
## Compatibility
|
||||
|
||||
Converted and smoke-tested with a recent llama.cpp build.
|
||||
|
||||
## Credits
|
||||
|
||||
- Original model by [Egomnia S.p.A.](https://www.egomnia.com)
|
||||
- Archived by [eldavoo](https://huggingface.co/eldavoo/emma-5)
|
||||
- GGUF conversion by [Spadav](https://github.com/Spadav)
|
||||
|
||||
This is an unofficial conversion.
|
||||
3
emma-5-f16.gguf
Normal file
3
emma-5-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:93f4a105c901704d452a87b95bdbe8376cedc28986c23dcf0d004ed0ff4a0690
|
||||
size 1230035008
|
||||
Reference in New Issue
Block a user