commit 4bd2bc12f4884ea129a6c7ab92db6e742f7f55ac Author: ModelHub XC Date: Tue May 5 12:52:37 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..11047ec --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf new file mode 100644 index 0000000..e31172b --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:344f84c72d39c8c184b6694e40870f0d36a9fd772bdd132dc9686f7659d28e64 +size 1127023808 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf new file mode 100644 index 0000000..8d96cfc --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35efa7146c01187fda615b220c14ec948fde7e0e7acacd166385d28989cd2e8c +size 1055261888 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf new file mode 100644 index 0000000..2a9c547 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3d3a0f7f279f52d08bf9a7bd3ec9e8e3da2317b6338135d66fd0ac11624b7462 +size 1512989888 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf new file mode 100644 index 0000000..f822288 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5432dba75d740ab5079ee09b1564f716150199f42c49c71aad04845d37dd55c4 +size 1417307328 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..dfe7fa2 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c764dbea43cee3ae3c1d390671edeaeb00c8d72e59926814dc2a5d7422f865b8 +size 1354106048 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..ad5e39a --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a0c2738d583c2980e5f518ff73b7ffb3eb36e0b5f8bdad9385dfc95480819a1c +size 1246627008 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf new file mode 100644 index 0000000..2ab0e7a --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7f49555810c553c682635577e83906d1070eb5f6517c7ea3c62780a10aa02674 +size 1962902208 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf new file mode 100644 index 0000000..5f17357 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f64f90aa682e1e5ef2e374599044ba0005b3b921fbd79dccfb989f7177d88ff8 +size 1899537088 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..3506318 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1cdcc1af5cf8082bfa2551c04f43a2e53f0399f5800b2218f699ee8fea956b15 +size 1814381248 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..b7ba7d2 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bdd76c7935e6bb6d7b2e3b3c6b178d90c24901e1eb2ce39c0040c18bb1f8af81 +size 1670194368 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..e94ab9e --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:793376ba27524aa914b7b62c8271917b6ed747f84ab1d300673d0d8a12429c27 +size 2381349568 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf b/Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..b284bad --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:20228a7c46dbf6aae439b3e121e9e2c6ec403cbb5abdda155108ba9c56d0fec8 +size 2270757568 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf new file mode 100644 index 0000000..61ea593 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93cd5dca52c9ae2c5a7fd25a270294945349a863c9fc977e6b8d80c255176c0f +size 1669505728 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..2ba9576 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a158762ede1e60e93f55a3a8e8895b342869aa526c3f1af5a80422e95a01d7a4 +size 1563460288 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..db6785f --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65e375578c1ff8a572ae2a623093d670022aab7f7a1049837a774b2024aa0158 +size 2239791808 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..3fdda38 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e1a1927773ce34af07d5ce0d91a230ecbbcc385a2580f107791927d1fe3136a8 +size 2075624128 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..b274a80 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe7aa09a3f270f471dbfce113dfb0662ae0ed2be7f5aa8c6a59c8116064f3da0 +size 1887003328 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf new file mode 100644 index 0000000..cef1b62 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:439e21faa31629634de1611d26eabcbf935bcf5cc4fe369037f186e253e7bc1f +size 2375779008 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf new file mode 100644 index 0000000..02e1612 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35e372ef1c80935de4dc24c26beaa6519077ea4403c8fbc9270211b6a798a487 +size 2596635328 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..88099a8 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:371c90723df1736e0f164de2e7422da7e5040e60215312b10e354358d04b8c23 +size 2497286848 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..10d55ac --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9274fc0d003fd5a5f0d77fcfc018b21bca48490b216e4e79b9fe36038a3f9813 +size 2383315648 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..4703641 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b8ee0b65653ad3d19ef5b0a9a23d95f13280ff5c81364c5458307a7e3d19843d +size 2889519808 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3394703 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bb046b05e638f1d51a2153567b8e18c5107f74c18ea85ad7ef4d8caa2c619576 +size 2823717568 diff --git a/Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf b/Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf new file mode 100644 index 0000000..a359b6e --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:83fb7d197051f6a25d6c2dccffca544224402fc62773744d7e4ac01a233ebd2d +size 3306267328 diff --git a/Muscae-Qwen3-UI-Code-4B.imatrix.gguf b/Muscae-Qwen3-UI-Code-4B.imatrix.gguf new file mode 100644 index 0000000..e7e4988 --- /dev/null +++ b/Muscae-Qwen3-UI-Code-4B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c406499771f38038da2569c889d82c6f8a7fba9798ae5884815fa567d19720d7 +size 3872640 diff --git a/README.md b/README.md new file mode 100644 index 0000000..f85f1aa --- /dev/null +++ b/README.md @@ -0,0 +1,98 @@ +--- +base_model: prithivMLmods/Muscae-Qwen3-UI-Code-4B +language: +- en +- zh +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- trl +- gpt_oss +- code +- ui +- web +- .tsx +- .html +- .css +- abliterated +- text-generation-inference +- web-ui +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/prithivMLmods/Muscae-Qwen3-UI-Code-4B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Muscae-Qwen3-UI-Code-4B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +