初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Logics-Qwen3-Math-4B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Logics-Qwen3-Math-4B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ1_M.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9fd7826c666f6b55a6f5793045c934f7745c508456c1a9a11cbbdb20300b4862
|
||||||
|
size 1126541536
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ1_S.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:62cb74c6efdf81931600ea7784f9ea83886f4af69db6bf1a1f330f40a13597ac
|
||||||
|
size 1054779616
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ2_M.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f3ac3c72a1c0580ede498c1fd70f37d93a27876615cb6362c8d573912981524d
|
||||||
|
size 1512507616
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ2_S.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b5520e33b8e0b1fafdcb1326659a51bd4d9eaafdfac9d9d92bf31f7b852ec73b
|
||||||
|
size 1416825056
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ2_XS.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e034142a8f8d87ac11bdf2fb334fb77f15e8f769cccefe28a72735af151f6620
|
||||||
|
size 1353623776
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ2_XXS.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:da8940600408f8b365a62023bab30b2ea80c1f58b6c72e5137cf6e192032dd8e
|
||||||
|
size 1246144736
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ3_M.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ad7ff6f7c0258cd193bfcca81e0def21939286a1865516ae0a0a9bf71ba4a2b3
|
||||||
|
size 1962329184
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ3_S.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:251c4ec97fe836b9a4d8eee885c58fb56c8f50120f17694cfe05721ed1634629
|
||||||
|
size 1898964064
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ3_XS.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4af04dda430d3dced6e2087ee3e728a491a7849b8c1cc6d7639fb79a1e1c5fb1
|
||||||
|
size 1813808224
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ3_XXS.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f6a833f1bd3b77a5abb0404f667fa2268619ee707aabd9ffc5918407e84d46e8
|
||||||
|
size 1669712096
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ4_NL.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3e6ae8573c11f5d78ce85c1442880240dd4acad269e568871d28cbf27a5e1cc0
|
||||||
|
size 2380776544
|
||||||
3
Logics-Qwen3-Math-4B.i1-IQ4_XS.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:401c9c8c1a4afedb3feb0296578ad87ccac18331c44ecfb386dbd0710957f06e
|
||||||
|
size 2270184544
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q2_K.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:67d9b67fe2c6ed8870f4eb10f14201741990c681ee2a2c0f73287446ff36f48e
|
||||||
|
size 1668932704
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q2_K_S.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:47e510891f299ef42e4a2603b7a0e679568caf9901cd252efb28081047907bdc
|
||||||
|
size 1562887264
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q3_K_L.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:55ee0918c3fbf7dd042c1e3d3696f93f297bcdce0ba47cb8a5c471595be13acc
|
||||||
|
size 2239218784
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q3_K_M.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9e43379b127e8171189268a8c9f48ca50871f7fbbfc822cbdbd1d40905fdef39
|
||||||
|
size 2075051104
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q3_K_S.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:70b7296bf2eb19007521c1bd10f7c4ac678a41a0054056d07472f516bfcdf83e
|
||||||
|
size 1886430304
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q4_0.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:28295d6b436a26df6787af6b25b03faa2d11203def9e68eefefd9689864005c6
|
||||||
|
size 2375205984
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q4_1.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e6ab25f4a6b61939cfbb26742b72cf7af0e7a8ab8a820a10754d25710dc478ac
|
||||||
|
size 2596062304
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q4_K_M.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2826cb0041d5c90fb7cb8bbf6b3643e1993790d7b4f32fe13477d71c26962dfd
|
||||||
|
size 2496713824
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q4_K_S.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c03f0e0bacecde1697e2110d26fe59e9a46d0a1540eb9d9102e23484a8e21ffb
|
||||||
|
size 2382742624
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q5_K_M.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9dd70fb587f25cb84fdf5963511e0b647408285a5fb03996a2e0575a2b1353d0
|
||||||
|
size 2888946784
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q5_K_S.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1ea7a8fc924d64cbfea0146460bf844eccf5cc67ebd2c3145dd6e928c3f5b7f8
|
||||||
|
size 2823144544
|
||||||
3
Logics-Qwen3-Math-4B.i1-Q6_K.gguf
Normal file
3
Logics-Qwen3-Math-4B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bf7898c3cd58ec34f4cb3f65c43c588fd44f82139b6680f6cdd6c32f7c810bb3
|
||||||
|
size 3305694304
|
||||||
3
Logics-Qwen3-Math-4B.imatrix.gguf
Normal file
3
Logics-Qwen3-Math-4B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:25a3035ba60f4c94b32efe6cf9d24f40a6a41ee15277712179e56a9c15fed1e0
|
||||||
|
size 3872640
|
||||||
94
README.md
Normal file
94
README.md
Normal file
@@ -0,0 +1,94 @@
|
|||||||
|
---
|
||||||
|
base_model: prithivMLmods/Logics-Qwen3-Math-4B
|
||||||
|
datasets:
|
||||||
|
- nvidia/OpenCodeReasoning
|
||||||
|
- nvidia/OpenMathReasoning
|
||||||
|
- prithivMLmods/Helios-R-6M
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
license: apache-2.0
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- trl
|
||||||
|
- math
|
||||||
|
- text-generation-inference
|
||||||
|
- code
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||||
|
<!-- ### quants_skip: -->
|
||||||
|
<!-- ### skip_mmproj: -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Logics-Qwen3-Math-4B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Logics-Qwen3-Math-4B-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Logics-Qwen3-Math-4B-i1-GGUF/resolve/main/Logics-Qwen3-Math-4B.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user