mradermacher/Qwen2-Math-1.5B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen2-Math-1.5B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-11 21:46:58 +08:00
commit 0179a29201
27 changed files with 213 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-1.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen2-Math-1.5B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58ba3bf8f90b9ca5c9627695e28ca219fd6514d0eae3d214132ab473a3ec3f4e
size 464459296

3
Qwen2-Math-1.5B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:016c6407ab53689dbf2c59617ac29cce92549bedcc1a52a5eb8bb1ad18a46b6a
size 436525600

3
Qwen2-Math-1.5B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:743e571ee3abdabe64773af7c4c56ec9b095712e8e75fc254cd6ce488ddbde13
size 601052704

3
Qwen2-Math-1.5B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f25ebf4c60232df4389e3742757972942794259ff7acf15bc1d2379065785cc
size 563807776

3
Qwen2-Math-1.5B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef87494ac766ee29ac872b495647f847c00c06d70808ba2dc5688ce5bde3eaee
size 550324768

3
Qwen2-Math-1.5B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee7439c83698b4eed460b502e79721f6828e4d0050251702ed763caa0a97ff1e
size 511015456

3
Qwen2-Math-1.5B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:777704aeaa1daad175b4ed20bdccce9ad466d7af2e251a29103d6642b38d0a4d
size 776662048

3
Qwen2-Math-1.5B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1746edf9febdf772084b03b0868efb6015ab261bc0d624930c5c4e93d4754e3
size 762404896

3
Qwen2-Math-1.5B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29b05baefad7f6e0e3b1b4a99d2ee1ae7b98676ed8b31168d3cae2c37239721f
size 731697184

3
Qwen2-Math-1.5B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86b540bee87fbd52f0699b2fe6d1e3beac4b3d5cf6766a11cf6cf34d24087d59
size 668790304

3
Qwen2-Math-1.5B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c252a0b2004e0789209d4cf974bc97c4cb71372b79f9090c4276b0750f43274
size 936329248

3
Qwen2-Math-1.5B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11812e21f3a3feb46372dea9c3414b3e187a84ef91e74d7a27f880edda1022a5
size 895729696

3
Qwen2-Math-1.5B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6646e72e4ea68e5c4fd4cbe37bb9b39650075eca87b04818b38bc23edae4b3a1
size 676302880

3
Qwen2-Math-1.5B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92c59dc21073577d81902ab4cb19282e5fd3f6bf1c378483de98be7b1df76492
size 640133152

3
Qwen2-Math-1.5B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cfa94ba167c8e9c17d6f77c0af9a360f6c1585a8bf60fb6640c788f8c9517a12
size 880160800

3
Qwen2-Math-1.5B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5bd70245df3ea9450d8b7119477c8c557e2d29a7d9d82d68a1695358d0f6c2b8
size 824176672

3
Qwen2-Math-1.5B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f6ca0b1812e8a9ab969366968481ea6b90a884a151092c2f254594a272bae58
size 760942624

3
Qwen2-Math-1.5B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09ca24a2416af198feeb79542eb016daedc69718ff4b4509a036790166985e58
size 937533472

3
Qwen2-Math-1.5B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3445e5a4b8fecd516aa36717552edd2605a6bc4cca27ef12de1f192ccb688d9
size 1016840224

3
Qwen2-Math-1.5B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b77d5fa34f6e689105f88b8ef832f3d0d3ec8b3858c98530a5d50f7416c8f4f
size 986046496

3
Qwen2-Math-1.5B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2047faea3d16350a6469daa6389f41ed499ef2ce715ee32434c53a77a7494328
size 940310560

3
Qwen2-Math-1.5B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d81fd6688e3776e1e85088ccb978984a1e436267c8ef521f7cdf9e18bf209e0
size 1125048352

3
Qwen2-Math-1.5B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d714b423dbd3823005ae3bc2947583d014f3e54dc513910a67808f3d6179a0fb
size 1098727456

3
Qwen2-Math-1.5B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea25baf8f710bf0527d8aab110aea7b74bbb5d9767735aa24991dccbd7808f2a
size 1272737824

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: Qwen/Qwen2-Math-1.5B
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- chat
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Qwen/Qwen2-Math-1.5B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Qwen2-Math-1.5B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42b46c0a86a820fe130496c28044bb38673d31a0d3e366dfb34b7a68e8dc2508
size 2042201