commit 5cce0c3cf8652ed4084c5b7fbf282bb818c4b4e6 Author: ModelHub XC Date: Sun May 10 04:15:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..3afd3e7 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +EuroLLM-22B-Instruct-2512.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ1_M.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ1_M.gguf new file mode 100644 index 0000000..ffb3880 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f9208d1f23c5ccdff458ca110f7670508072f480086a332aaf68b77706484121 +size 5674669792 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ1_S.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ1_S.gguf new file mode 100644 index 0000000..df77906 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:819132eb990550835402928feb2f98ebe6b3bbee68a86b65ef3de96fa44724d1 +size 5250881248 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ2_M.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ2_M.gguf new file mode 100644 index 0000000..6d8696a --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61fe42b0a1fccea3ef4f899d3a9a6f1689a9c53bc37dd48ebf26d416c2414c00 +size 8002655968 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ2_S.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ2_S.gguf new file mode 100644 index 0000000..4c7737f --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:656cfddce63d7e618991e3ffbd1daa7b30af7eae3af8fd39e75768ef21bc0ffd +size 7437604576 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ2_XS.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ2_XS.gguf new file mode 100644 index 0000000..90b2348 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e93ad18492c1af4fee44965f0986fb8579b0d8bb15e3ac4d590bd6312777a899 +size 7009736416 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ2_XXS.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..551a416 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:67f16bce95e3ec8fe5410cb35f3ac833c6e60316de59076548d76c9cf3a787ee +size 6380984032 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ3_M.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ3_M.gguf new file mode 100644 index 0000000..fe8f5b2 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:14de23fc2cbef37c07af1116ca9f0fa2100b638b9212fa4e31c04111eb0ac1e8 +size 10435729120 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ3_S.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ3_S.gguf new file mode 100644 index 0000000..506c83d --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5b97443242413fb242e691a2af8ef33fdb7b303f9434261e7cd5632cb2aed16b +size 10084783840 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ3_XS.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ3_XS.gguf new file mode 100644 index 0000000..570f0e8 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:20af580176aea391ddf1de48af99cec5b174822d369ccb929ebdf86127b02e7e +size 9586382560 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ3_XXS.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..23d1aba --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a147b38e5527bea366ea330fb8cc09f237cc91c3a77d1f5d719089c9e80136ff +size 8955811552 diff --git a/EuroLLM-22B-Instruct-2512.i1-IQ4_XS.gguf b/EuroLLM-22B-Instruct-2512.i1-IQ4_XS.gguf new file mode 100644 index 0000000..899d4a1 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:629dac781a1f1c6be65bfadf7f2c98bda081a37dbfe1245df860fcadeb9e623e +size 12311910112 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q2_K.gguf b/EuroLLM-22B-Instruct-2512.i1-Q2_K.gguf new file mode 100644 index 0000000..b9ffd3b --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:827b53012aec758eae29ac1537ba160c440aa47e173225c4bc135b75dc4cb030 +size 8659228384 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q2_K_S.gguf b/EuroLLM-22B-Instruct-2512.i1-Q2_K_S.gguf new file mode 100644 index 0000000..6e95be5 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8726a1402b5f9e71438e11b706cd750c827c056dedfecc4322dc96c7e2e74ece +size 8041682656 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q3_K_L.gguf b/EuroLLM-22B-Instruct-2512.i1-Q3_K_L.gguf new file mode 100644 index 0000000..77b8b63 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2419a9736df14092f639fa646e73760a62c802201e5cbc5d12e9ff1bd38e0485 +size 12054206176 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q3_K_M.gguf b/EuroLLM-22B-Instruct-2512.i1-Q3_K_M.gguf new file mode 100644 index 0000000..9a5de9e --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7815fe9478770fb25b919e9f0f18db8f33b4026100326ebded7e1ca3da73cbac +size 11116779232 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q3_K_S.gguf b/EuroLLM-22B-Instruct-2512.i1-Q3_K_S.gguf new file mode 100644 index 0000000..82c2550 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2f569063a88d74d6d947b7cc95931ac54ce6b0eb6833ae9d4e117cb828297941 +size 10039662304 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q4_0.gguf b/EuroLLM-22B-Instruct-2512.i1-Q4_0.gguf new file mode 100644 index 0000000..5a11d5a --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90286e47c640bb4af8021c773a159085997e537355ce4a62db44467dc47eda5e +size 12979394272 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q4_1.gguf b/EuroLLM-22B-Instruct-2512.i1-Q4_1.gguf new file mode 100644 index 0000000..a3bb1b8 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:33adf698032b9e7dfe798586f0c5a79906464abaee2330ee97311f6d2d901547 +size 14307284704 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q4_K_M.gguf b/EuroLLM-22B-Instruct-2512.i1-Q4_K_M.gguf new file mode 100644 index 0000000..7ada30c --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2a56b2e8141aa5e4ee9657779a4adc8878a0cc1ac37c664130cdf8a2186d3945 +size 13658576608 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q4_K_S.gguf b/EuroLLM-22B-Instruct-2512.i1-Q4_K_S.gguf new file mode 100644 index 0000000..8686374 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6d2216928cb8071bfc0f56a6b1842cd242db1277f5b1b6ca7b34eaa728458d68 +size 13020288736 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q5_K_M.gguf b/EuroLLM-22B-Instruct-2512.i1-Q5_K_M.gguf new file mode 100644 index 0000000..d276402 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a378ef12c1429cb13dcefd51c208844226b32b9c8402911abc3a9deb75e5ce69 +size 16042252000 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q5_K_S.gguf b/EuroLLM-22B-Instruct-2512.i1-Q5_K_S.gguf new file mode 100644 index 0000000..f1ffcaa --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f863541f9ea0f531747299e7810c82c567ca98cc0cb193d782fee9cf5a883df +size 15672923872 diff --git a/EuroLLM-22B-Instruct-2512.i1-Q6_K.gguf b/EuroLLM-22B-Instruct-2512.i1-Q6_K.gguf new file mode 100644 index 0000000..f1ceb71 --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bb83b069df827859746845797353935c025d73cda251c701416e9aa922a7ce61 +size 18574907104 diff --git a/EuroLLM-22B-Instruct-2512.imatrix.gguf b/EuroLLM-22B-Instruct-2512.imatrix.gguf new file mode 100644 index 0000000..ef8cf1c --- /dev/null +++ b/EuroLLM-22B-Instruct-2512.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0cac9d1e136b1fdff06fce65288117da6ff8ff88e23319c3519291906e49c5e1 +size 11559712 diff --git a/README.md b/README.md new file mode 100644 index 0000000..ab035cb --- /dev/null +++ b/README.md @@ -0,0 +1,118 @@ +--- +base_model: utter-project/EuroLLM-22B-Instruct-2512 +language: +- en +- de +- es +- fr +- it +- pt +- pl +- nl +- tr +- sv +- cs +- el +- hu +- ro +- fi +- uk +- sl +- sk +- da +- lt +- lv +- et +- bg +- no +- ca +- hr +- ga +- mt +- gl +- zh +- ru +- ko +- ja +- ar +- hi +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/utter-project/EuroLLM-22B-Instruct-2512 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#EuroLLM-22B-Instruct-2512-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ1_M.gguf) | i1-IQ1_M | 5.8 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.5 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.1 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ2_S.gguf) | i1-IQ2_S | 7.5 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ2_M.gguf) | i1-IQ2_M | 8.1 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.1 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q2_K.gguf) | i1-Q2_K | 8.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.1 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ3_XS.gguf) | i1-IQ3_XS | 9.7 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.1 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ3_S.gguf) | i1-IQ3_S | 10.2 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ3_M.gguf) | i1-IQ3_M | 10.5 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.2 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.4 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q4_0.gguf) | i1-Q4_0 | 13.1 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.1 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q4_K_M.gguf) | i1-Q4_K_M | 13.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q4_1.gguf) | i1-Q4_1 | 14.4 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q5_K_S.gguf) | i1-Q5_K_S | 15.8 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.1 | | +| [GGUF](https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-i1-GGUF/resolve/main/EuroLLM-22B-Instruct-2512.i1-Q6_K.gguf) | i1-Q6_K | 18.7 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +