commit 11813cf579b4df2e7590b4ae514b5daecee3d018 Author: ModelHub XC Date: Wed Jun 3 22:20:25 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..e03ece1 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf new file mode 100644 index 0000000..18fa4a8 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0715946b3a4103b7daaf569fbea112915d326f8a82b1111313dd23cf8baebf75 +size 1124730592 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf new file mode 100644 index 0000000..baa14b6 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:52b0c26971bebaf3b0d0587f0f3a15e3b6fc17c5000b87fb4f95aa55fb65295a +size 1026684640 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf new file mode 100644 index 0000000..1815414 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1399f5b9a0663e7a734bca0fbe07763090ac52b90d7761dd0d7de3aafee0676d +size 1615533792 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf new file mode 100644 index 0000000..a4f8cbc --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e719eecdc8d2fef803da857a4db9580f9d169165750a10761a808f0e233f092f +size 1484805856 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf new file mode 100644 index 0000000..e575743 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fee082e5c6c6b8ab7f28165358ab025eeeaafdb82086cf7e098bc8e94c89d9d9 +size 1426732768 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..0f56d73 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95b22a9eb9341d66804475a3dc5a7868323724bcbfdd303ef1fb0da8629c01bc +size 1288140512 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf new file mode 100644 index 0000000..3e0614f --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3fd491322bcabb264e42c9e80d6b6edbead1e5e883bea776c4ac1d2c88b5ada7 +size 2136168160 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf new file mode 100644 index 0000000..44d690c --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ce273f4e146b56b2a7f85ef9691ed16d886f302aadbdf86824a6e65500a025f +size 2081785568 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf new file mode 100644 index 0000000..9332539 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:224af9e4af547e11271ea8ee5a8cd972f8765377278301ff7e4bb6c6c82190fd +size 1973405408 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..73ed43b --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:43e71ec7eb82431b168a60bea7062a644512ad85bc3abcb781739cd574e10021 +size 1851897568 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf new file mode 100644 index 0000000..e60d7bb --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e44a1722a99f90849d540f6065f7591af53ecdc0a78befac29237d7d3997c25d +size 2704398048 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf b/Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf new file mode 100644 index 0000000..0f0339e --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:00a55ffae1721b62a84858351822928eb8f0493b1099f83ff7f02f7d8fbda851 +size 2558826208 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf new file mode 100644 index 0000000..a4df366 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:84cd0e3e733f84092051daf4fc29bbc406ca1481c860bd63e0228042a0a124ed +size 1771615968 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf new file mode 100644 index 0000000..8c9c140 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd8aec27b4f6c1d686cdd6a20353c74844bf1d741a3c721ef4f2e57cf89f5556 +size 1645663968 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf new file mode 100644 index 0000000..5f384d8 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c5951f7152e0cf46380e30f2af13244103accc2c98ecac731c56918ca63d1aa5 +size 2499331808 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf new file mode 100644 index 0000000..463b24b --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ad372c2bb060111e81fe8fd81c3ce3354c0c88a2b5a302afe17aa27edd1015f8 +size 2303444704 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf new file mode 100644 index 0000000..40bed01 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b6a51086b15d9d7c5ede695b864b1f891b73a69e9e53230f96d439a382abdadc +size 2077607648 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf new file mode 100644 index 0000000..2e937a6 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7336a1cce6fb1a007483c87c2e9ec1dd17c1c69101fcb9f0ae9abb128fff8c30 +size 2710329056 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf new file mode 100644 index 0000000..a3b9d3c --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0813381f98ae36e8b5203e947f0cb62f9e1e267e7e1740a3b6a527a340265a6e +size 2993575648 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf new file mode 100644 index 0000000..cfb1810 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1dc5db5c0aad2f6432274c96bd62aeded1bebca7ac09c9220b197c43d106a191 +size 2878887648 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf new file mode 100644 index 0000000..c08417f --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8b5a5f7c49d10fa553defc4aed488a696cf14bd80f31d6416f248662ccd50f7c +size 2720454368 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf new file mode 100644 index 0000000..7d38892 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:be577170afd92faf9e2a03c3c402b619c280739f8e8d09d795afa1429e54bc0d +size 3378599648 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf new file mode 100644 index 0000000..a12e96b --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cee4047f9c8fb93e6c55a9b14a8ef34be9236700884104aaf1a8cdb0f1e86af3 +size 3286685408 diff --git a/Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf b/Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf new file mode 100644 index 0000000..cbdc0b0 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:66b4f711543a853dcebe4364eba1f0d40e98764bf3f82286ff5bf9ead0ea4933 +size 3909543648 diff --git a/Bielik-4.5B-v3.0-medadapt.imatrix.gguf b/Bielik-4.5B-v3.0-medadapt.imatrix.gguf new file mode 100644 index 0000000..f4e29c7 --- /dev/null +++ b/Bielik-4.5B-v3.0-medadapt.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd18efad3946df184028ef477623046cd6a5ba81780f8116252b4c4dd8b7e734 +size 5655616 diff --git a/README.md b/README.md new file mode 100644 index 0000000..b4540a9 --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: jmajkutewicz/Bielik-4.5B-v3.0-medadapt +language: +- pl +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- polish +- medical +- domain-adaptation +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/jmajkutewicz/Bielik-4.5B-v3.0-medadapt + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Bielik-4.5B-v3.0-medadapt-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf) | i1-IQ1_S | 1.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf) | i1-IQ2_S | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf) | i1-IQ2_M | 1.7 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf) | i1-Q2_K | 1.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.0 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.2 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf) | i1-IQ3_S | 2.2 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf) | i1-IQ3_M | 2.2 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.4 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf) | i1-Q4_0 | 2.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf) | i1-Q4_K_M | 3.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf) | i1-Q4_1 | 3.1 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf) | i1-Q5_K_S | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.5 | | +| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf) | i1-Q6_K | 4.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +