From b6730e76a1432647cc44c2cf71caab5ae61646c6 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Mon, 10 Aug 2026 02:00:17 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: layerx-labs/AMALIA-9B-0626-DPO-GGUF Source: Original Platform --- .gitattributes | 39 ++++++++++++++++++++++++++ AMALIA-9B-0626-DPO-BF16.gguf | 3 ++ AMALIA-9B-0626-DPO-Q4_K_M.gguf | 3 ++ AMALIA-9B-0626-DPO-Q4_K_S.gguf | 3 ++ AMALIA-9B-0626-DPO-Q8_0.gguf | 3 ++ README.md | 51 ++++++++++++++++++++++++++++++++++ 6 files changed, 102 insertions(+) create mode 100644 .gitattributes create mode 100644 AMALIA-9B-0626-DPO-BF16.gguf create mode 100644 AMALIA-9B-0626-DPO-Q4_K_M.gguf create mode 100644 AMALIA-9B-0626-DPO-Q4_K_S.gguf create mode 100644 AMALIA-9B-0626-DPO-Q8_0.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..88ab81d --- /dev/null +++ b/.gitattributes @@ -0,0 +1,39 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +AMALIA-9B-0626-DPO-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +AMALIA-9B-0626-DPO-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +AMALIA-9B-0626-DPO-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +AMALIA-9B-0626-DPO-BF16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/AMALIA-9B-0626-DPO-BF16.gguf b/AMALIA-9B-0626-DPO-BF16.gguf new file mode 100644 index 0000000..382fdbd --- /dev/null +++ b/AMALIA-9B-0626-DPO-BF16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5d97727ae6a18c32f9f341629e65f210ae0441d2d42b594a960ca0fa640cfc6e +size 18308422528 diff --git a/AMALIA-9B-0626-DPO-Q4_K_M.gguf b/AMALIA-9B-0626-DPO-Q4_K_M.gguf new file mode 100644 index 0000000..c0ebeae --- /dev/null +++ b/AMALIA-9B-0626-DPO-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:57d06539411175a7883e45de189ef9215604409ee1bdad0119cb615e46fae37b +size 5582838624 diff --git a/AMALIA-9B-0626-DPO-Q4_K_S.gguf b/AMALIA-9B-0626-DPO-Q4_K_S.gguf new file mode 100644 index 0000000..7e8d9cb --- /dev/null +++ b/AMALIA-9B-0626-DPO-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71395d200b344a853b05375004ea2873cb23803a66b81e1026448584c3d8aa2b +size 5321186176 diff --git a/AMALIA-9B-0626-DPO-Q8_0.gguf b/AMALIA-9B-0626-DPO-Q8_0.gguf new file mode 100644 index 0000000..2133aca --- /dev/null +++ b/AMALIA-9B-0626-DPO-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24164e23aefe73f5b74fd6d83c5cc13bd37b75c42a38bfa674ca64581ba9a783 +size 9728449376 diff --git a/README.md b/README.md new file mode 100644 index 0000000..18e76e6 --- /dev/null +++ b/README.md @@ -0,0 +1,51 @@ +--- +license: apache-2.0 +language: +- pt +base_model: +- amalia-llm/AMALIA-9B-0626-DPO +base_model_relation: quantized +pipeline_tag: text-generation +library_name: llama.cpp +tags: +- gguf +- llama.cpp +- quantized +- portuguese +- european-portuguese +- amalia +--- + +# AMALIA-9B-0626-DPO — GGUF + +GGUF quantizations of [amalia-llm/AMALIA-9B-0626-DPO](https://huggingface.co/amalia-llm/AMALIA-9B-0626-DPO) for use with [llama.cpp](https://github.com/ggml-org/llama.cpp) and compatible runtimes (LM Studio, Ollama, Jan, etc.). + +AMALIA is an open-source language model targeting European Portuguese, developed by a consortium of Portuguese universities and research centres and funded by the Government of Portugal. This is the DPO (preference-tuned) variant. See the [original model card](https://huggingface.co/amalia-llm/AMALIA-9B-0626-DPO) and the [technical report](https://arxiv.org/abs/2603.26511) for full details. + +## Files + +| File | Quant | Size | Notes | +| --- | --- | --- | --- | +| `AMALIA-9B-0626-DPO-Q4_K_S.gguf` | Q4_K_S | ~5.4 GB | 4-bit small, quantized directly from bf16 | +| `AMALIA-9B-0626-DPO-Q4_K_M.gguf` | Q4_K_M | ~5.6 GB | 4-bit medium, recommended balance of quality and size | +| `AMALIA-9B-0626-DPO-Q8_0.gguf` | Q8_0 | ~9.7 GB | 8-bit, near-lossless | +| `AMALIA-9B-0626-DPO-BF16.gguf` | BF16 | ~18.3 GB | full-precision original weights in GGUF | + +Converted with `convert_hf_to_gguf.py` (llama.cpp b8470) from the original bf16 weights. BF16 and Q4_K_S come directly from the original weights; Q8_0 was converted directly from bf16 and Q4_K_M was requantized from that Q8_0 (Q8_0 is near-lossless relative to bf16). The chat template (ChatML with the AMALIA Portuguese system prompt) is embedded in the GGUF metadata. + +## Usage + +```bash +# llama.cpp CLI (chat template is picked up automatically) +llama-cli -hf layerx-labs/AMALIA-9B-0626-DPO-GGUF:Q4_K_M + +# or with a local file +llama-cli -m AMALIA-9B-0626-DPO-Q4_K_M.gguf -cnv + +# OpenAI-compatible server +llama-server -m AMALIA-9B-0626-DPO-Q4_K_M.gguf -c 8192 +``` + +## License + +Apache 2.0, same as the original model. All credit for the model goes to the [AMALIA project](https://amaliallm.pt/).