初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:344f84c72d39c8c184b6694e40870f0d36a9fd772bdd132dc9686f7659d28e64
|
||||
size 1127023808
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:35efa7146c01187fda615b220c14ec948fde7e0e7acacd166385d28989cd2e8c
|
||||
size 1055261888
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3d3a0f7f279f52d08bf9a7bd3ec9e8e3da2317b6338135d66fd0ac11624b7462
|
||||
size 1512989888
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5432dba75d740ab5079ee09b1564f716150199f42c49c71aad04845d37dd55c4
|
||||
size 1417307328
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c764dbea43cee3ae3c1d390671edeaeb00c8d72e59926814dc2a5d7422f865b8
|
||||
size 1354106048
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a0c2738d583c2980e5f518ff73b7ffb3eb36e0b5f8bdad9385dfc95480819a1c
|
||||
size 1246627008
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7f49555810c553c682635577e83906d1070eb5f6517c7ea3c62780a10aa02674
|
||||
size 1962902208
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f64f90aa682e1e5ef2e374599044ba0005b3b921fbd79dccfb989f7177d88ff8
|
||||
size 1899537088
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1cdcc1af5cf8082bfa2551c04f43a2e53f0399f5800b2218f699ee8fea956b15
|
||||
size 1814381248
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bdd76c7935e6bb6d7b2e3b3c6b178d90c24901e1eb2ce39c0040c18bb1f8af81
|
||||
size 1670194368
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:793376ba27524aa914b7b62c8271917b6ed747f84ab1d300673d0d8a12429c27
|
||||
size 2381349568
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:20228a7c46dbf6aae439b3e121e9e2c6ec403cbb5abdda155108ba9c56d0fec8
|
||||
size 2270757568
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:93cd5dca52c9ae2c5a7fd25a270294945349a863c9fc977e6b8d80c255176c0f
|
||||
size 1669505728
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a158762ede1e60e93f55a3a8e8895b342869aa526c3f1af5a80422e95a01d7a4
|
||||
size 1563460288
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:65e375578c1ff8a572ae2a623093d670022aab7f7a1049837a774b2024aa0158
|
||||
size 2239791808
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e1a1927773ce34af07d5ce0d91a230ecbbcc385a2580f107791927d1fe3136a8
|
||||
size 2075624128
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fe7aa09a3f270f471dbfce113dfb0662ae0ed2be7f5aa8c6a59c8116064f3da0
|
||||
size 1887003328
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:439e21faa31629634de1611d26eabcbf935bcf5cc4fe369037f186e253e7bc1f
|
||||
size 2375779008
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:35e372ef1c80935de4dc24c26beaa6519077ea4403c8fbc9270211b6a798a487
|
||||
size 2596635328
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:371c90723df1736e0f164de2e7422da7e5040e60215312b10e354358d04b8c23
|
||||
size 2497286848
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9274fc0d003fd5a5f0d77fcfc018b21bca48490b216e4e79b9fe36038a3f9813
|
||||
size 2383315648
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b8ee0b65653ad3d19ef5b0a9a23d95f13280ff5c81364c5458307a7e3d19843d
|
||||
size 2889519808
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bb046b05e638f1d51a2153567b8e18c5107f74c18ea85ad7ef4d8caa2c619576
|
||||
size 2823717568
|
||||
3
Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:83fb7d197051f6a25d6c2dccffca544224402fc62773744d7e4ac01a233ebd2d
|
||||
size 3306267328
|
||||
3
Muscae-Qwen3-UI-Code-4B.imatrix.gguf
Normal file
3
Muscae-Qwen3-UI-Code-4B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c406499771f38038da2569c889d82c6f8a7fba9798ae5884815fa567d19720d7
|
||||
size 3872640
|
||||
98
README.md
Normal file
98
README.md
Normal file
@@ -0,0 +1,98 @@
|
||||
---
|
||||
base_model: prithivMLmods/Muscae-Qwen3-UI-Code-4B
|
||||
language:
|
||||
- en
|
||||
- zh
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- trl
|
||||
- gpt_oss
|
||||
- code
|
||||
- ui
|
||||
- web
|
||||
- .tsx
|
||||
- .html
|
||||
- .css
|
||||
- abliterated
|
||||
- text-generation-inference
|
||||
- web-ui
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||
<!-- ### quants_skip: -->
|
||||
<!-- ### skip_mmproj: -->
|
||||
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Muscae-Qwen3-UI-Code-4B
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Muscae-Qwen3-UI-Code-4B-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Muscae-Qwen3-UI-Code-4B-i1-GGUF/resolve/main/Muscae-Qwen3-UI-Code-4B.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user