初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
DualMinded-Qwen3-1.7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ1_M.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2153070798ecec212291c6d8dd01550fdee5b2d0f813e5893467dd202b62043a
|
||||||
|
size 645895680
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ1_S.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:31a5cfc21ef739e1c4cf10a12a6361991032b3eedddc95a418fddb49e4584492
|
||||||
|
size 617879040
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ2_M.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1448e338006bd1eb3b8d8c91fa740683bed051f72b7fe033687fe199e4c054f8
|
||||||
|
size 828886528
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ2_S.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8c059ef0d50f0db91c699d80a3b3cf803db284e03f9c5eb5824de002ffd07cab
|
||||||
|
size 791531008
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ2_XS.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bf91ae11cef1c7f6a4253432ed6872309177361dfa5d2ecc0026cce32da30189
|
||||||
|
size 733615616
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ2_XXS.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:40f8c5ef7092469032acbe944545fda1056d0099bbefc7f4c4116854e751d52d
|
||||||
|
size 692590080
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ3_M.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b34226a9fe0b9a0da5bf78d53fe5cd2e429ca50200418df67f6b488d9d4d70fc
|
||||||
|
size 1029367296
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ3_S.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3760133130c700fdace8dcad07200dc0d7ea17b92cd42bdfc3e64a023c410985
|
||||||
|
size 1000957440
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ3_XS.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:28d81906f22513d9d4315b04c813440fd71400c5cca37365ec70a9107656412d
|
||||||
|
size 967927296
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ3_XXS.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:051a122f195cd9344911f68f04c72d67f6724ac6223cce4afa43cbe080986106
|
||||||
|
size 888065536
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ4_NL.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:964e734e581cc7c03d3adb21856937d00004c3e19c689bf031a8eef4fef14c22
|
||||||
|
size 1229454848
|
||||||
3
DualMinded-Qwen3-1.7B.i1-IQ4_XS.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6382795e2cc5ece14de0d43f22aed0973e0b494191f0119c5296910f9c136615
|
||||||
|
size 1175690752
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q2_K.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f5840d8142b4abbe13185ecfe45661717d1e07949505b295bcf86d9a0012dbb6
|
||||||
|
size 879898112
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q2_K_S.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:176a87c4b4fe9e05e5807ee44502a363156b0e3a5130d56899f4a82e8d354bd3
|
||||||
|
size 835071488
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q3_K_L.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b1f9ad4f42293176a3542a77035ea6c5c17fbbeb8cc37fe684729bb7203d1513
|
||||||
|
size 1137206784
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q3_K_M.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fb9c35e63136386e188d5df379522773f5efa520f4172e29c6d0e6b0ee316c3c
|
||||||
|
size 1073243648
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q3_K_S.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:91fb0ef6e16d4cd819e6f00667e67e9138fc69aef136147cfba3bd4b3fbbc779
|
||||||
|
size 1000957440
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q4_0.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6788c4b647973a541ca4cbe97ced00b3c754b3c44154b2b299bcca9ab0976d05
|
||||||
|
size 1231814144
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q4_1.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3628f15dbbe031ac154275babf963913a0cdeb26d4769cd2314cc0d88a54dd8e
|
||||||
|
size 1336983040
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q4_K_M.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0fbf317cc81e9d715c1047111239e443d6e60b7238144ee37faa425d4cb2e394
|
||||||
|
size 1282440704
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q4_K_S.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:130d957940a4081798940ec0d45ff7c4d297516c0e00926ebba4ece5f7a58f42
|
||||||
|
size 1235222016
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q5_K_M.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:29a10eb9916583d3d599fb6c4d898ea920008528a991e419cde9bf32441f0e82
|
||||||
|
size 1471806976
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q5_K_S.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6feb77daa8c6b7cfef10836dcec25bb3fb562a0487822894e6d0155d19b45fa5
|
||||||
|
size 1444511232
|
||||||
3
DualMinded-Qwen3-1.7B.i1-Q6_K.gguf
Normal file
3
DualMinded-Qwen3-1.7B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:98f73133ad626175771f9e64518f24576967bce47fac953f48857335dfa7a6e9
|
||||||
|
size 1673008640
|
||||||
3
DualMinded-Qwen3-1.7B.imatrix.gguf
Normal file
3
DualMinded-Qwen3-1.7B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2697d75a97e2de0cd0a99061ed351d1bc9aa40ef8addf8d2143e02be92b08cc5
|
||||||
|
size 2094560
|
||||||
100
README.md
Normal file
100
README.md
Normal file
@@ -0,0 +1,100 @@
|
|||||||
|
---
|
||||||
|
base_model: reaperdoesntknow/DualMinded-Qwen3-1.7B
|
||||||
|
datasets:
|
||||||
|
- nohurry/Opus-4.6-Reasoning-3000x-filtered
|
||||||
|
- zai-org/LongWriter-6k
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
license: apache-2.0
|
||||||
|
model_name: DualMinded-Qwen3-1.7B
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- dualmind
|
||||||
|
- knowledge-distillation
|
||||||
|
- topology-aware
|
||||||
|
- self-critique
|
||||||
|
- opus
|
||||||
|
- convergent-intelligence
|
||||||
|
- qwen3
|
||||||
|
- convergentintel
|
||||||
|
- edge
|
||||||
|
- distillation
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||||
|
<!-- ### quants_skip: -->
|
||||||
|
<!-- ### skip_mmproj: -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/reaperdoesntknow/DualMinded-Qwen3-1.7B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#DualMinded-Qwen3-1.7B-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.9 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q2_K.gguf) | i1-Q2_K | 1.0 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.0 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.1 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.1 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.1 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.1 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.2 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.2 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.3 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.3 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q4_0.gguf) | i1-Q4_0 | 1.3 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.3 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.4 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q4_1.gguf) | i1-Q4_1 | 1.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.6 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/DualMinded-Qwen3-1.7B-i1-GGUF/resolve/main/DualMinded-Qwen3-1.7B.i1-Q6_K.gguf) | i1-Q6_K | 1.8 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user