初始化项目,由ModelHub XC社区提供模型
Model: layerx-labs/AMALIA-9B-0626-DPO-GGUF Source: Original Platform
This commit is contained in:
39
.gitattributes
vendored
Normal file
39
.gitattributes
vendored
Normal file
@@ -0,0 +1,39 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
AMALIA-9B-0626-DPO-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
AMALIA-9B-0626-DPO-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
AMALIA-9B-0626-DPO-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
AMALIA-9B-0626-DPO-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
AMALIA-9B-0626-DPO-BF16.gguf
Normal file
3
AMALIA-9B-0626-DPO-BF16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5d97727ae6a18c32f9f341629e65f210ae0441d2d42b594a960ca0fa640cfc6e
|
||||||
|
size 18308422528
|
||||||
3
AMALIA-9B-0626-DPO-Q4_K_M.gguf
Normal file
3
AMALIA-9B-0626-DPO-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:57d06539411175a7883e45de189ef9215604409ee1bdad0119cb615e46fae37b
|
||||||
|
size 5582838624
|
||||||
3
AMALIA-9B-0626-DPO-Q4_K_S.gguf
Normal file
3
AMALIA-9B-0626-DPO-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:71395d200b344a853b05375004ea2873cb23803a66b81e1026448584c3d8aa2b
|
||||||
|
size 5321186176
|
||||||
3
AMALIA-9B-0626-DPO-Q8_0.gguf
Normal file
3
AMALIA-9B-0626-DPO-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:24164e23aefe73f5b74fd6d83c5cc13bd37b75c42a38bfa674ca64581ba9a783
|
||||||
|
size 9728449376
|
||||||
51
README.md
Normal file
51
README.md
Normal file
@@ -0,0 +1,51 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- pt
|
||||||
|
base_model:
|
||||||
|
- amalia-llm/AMALIA-9B-0626-DPO
|
||||||
|
base_model_relation: quantized
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
library_name: llama.cpp
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- llama.cpp
|
||||||
|
- quantized
|
||||||
|
- portuguese
|
||||||
|
- european-portuguese
|
||||||
|
- amalia
|
||||||
|
---
|
||||||
|
|
||||||
|
# AMALIA-9B-0626-DPO — GGUF
|
||||||
|
|
||||||
|
GGUF quantizations of [amalia-llm/AMALIA-9B-0626-DPO](https://huggingface.co/amalia-llm/AMALIA-9B-0626-DPO) for use with [llama.cpp](https://github.com/ggml-org/llama.cpp) and compatible runtimes (LM Studio, Ollama, Jan, etc.).
|
||||||
|
|
||||||
|
AMALIA is an open-source language model targeting European Portuguese, developed by a consortium of Portuguese universities and research centres and funded by the Government of Portugal. This is the DPO (preference-tuned) variant. See the [original model card](https://huggingface.co/amalia-llm/AMALIA-9B-0626-DPO) and the [technical report](https://arxiv.org/abs/2603.26511) for full details.
|
||||||
|
|
||||||
|
## Files
|
||||||
|
|
||||||
|
| File | Quant | Size | Notes |
|
||||||
|
| --- | --- | --- | --- |
|
||||||
|
| `AMALIA-9B-0626-DPO-Q4_K_S.gguf` | Q4_K_S | ~5.4 GB | 4-bit small, quantized directly from bf16 |
|
||||||
|
| `AMALIA-9B-0626-DPO-Q4_K_M.gguf` | Q4_K_M | ~5.6 GB | 4-bit medium, recommended balance of quality and size |
|
||||||
|
| `AMALIA-9B-0626-DPO-Q8_0.gguf` | Q8_0 | ~9.7 GB | 8-bit, near-lossless |
|
||||||
|
| `AMALIA-9B-0626-DPO-BF16.gguf` | BF16 | ~18.3 GB | full-precision original weights in GGUF |
|
||||||
|
|
||||||
|
Converted with `convert_hf_to_gguf.py` (llama.cpp b8470) from the original bf16 weights. BF16 and Q4_K_S come directly from the original weights; Q8_0 was converted directly from bf16 and Q4_K_M was requantized from that Q8_0 (Q8_0 is near-lossless relative to bf16). The chat template (ChatML with the AMALIA Portuguese system prompt) is embedded in the GGUF metadata.
|
||||||
|
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# llama.cpp CLI (chat template is picked up automatically)
|
||||||
|
llama-cli -hf layerx-labs/AMALIA-9B-0626-DPO-GGUF:Q4_K_M
|
||||||
|
|
||||||
|
# or with a local file
|
||||||
|
llama-cli -m AMALIA-9B-0626-DPO-Q4_K_M.gguf -cnv
|
||||||
|
|
||||||
|
# OpenAI-compatible server
|
||||||
|
llama-server -m AMALIA-9B-0626-DPO-Q4_K_M.gguf -c 8192
|
||||||
|
```
|
||||||
|
|
||||||
|
## License
|
||||||
|
|
||||||
|
Apache 2.0, same as the original model. All credit for the model goes to the [AMALIA project](https://amaliallm.pt/).
|
||||||
Reference in New Issue
Block a user