commit 0179a29201d101299d46e404a853b61b2faf230a Author: ModelHub XC Date: Sat Apr 11 21:46:58 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen2-Math-1.5B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..c847e4d --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2-Math-1.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen2-Math-1.5B.i1-IQ1_M.gguf b/Qwen2-Math-1.5B.i1-IQ1_M.gguf new file mode 100644 index 0000000..2aaf035 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:58ba3bf8f90b9ca5c9627695e28ca219fd6514d0eae3d214132ab473a3ec3f4e +size 464459296 diff --git a/Qwen2-Math-1.5B.i1-IQ1_S.gguf b/Qwen2-Math-1.5B.i1-IQ1_S.gguf new file mode 100644 index 0000000..6d400c4 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:016c6407ab53689dbf2c59617ac29cce92549bedcc1a52a5eb8bb1ad18a46b6a +size 436525600 diff --git a/Qwen2-Math-1.5B.i1-IQ2_M.gguf b/Qwen2-Math-1.5B.i1-IQ2_M.gguf new file mode 100644 index 0000000..b0feba6 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:743e571ee3abdabe64773af7c4c56ec9b095712e8e75fc254cd6ce488ddbde13 +size 601052704 diff --git a/Qwen2-Math-1.5B.i1-IQ2_S.gguf b/Qwen2-Math-1.5B.i1-IQ2_S.gguf new file mode 100644 index 0000000..d24ed56 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0f25ebf4c60232df4389e3742757972942794259ff7acf15bc1d2379065785cc +size 563807776 diff --git a/Qwen2-Math-1.5B.i1-IQ2_XS.gguf b/Qwen2-Math-1.5B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..f5bc4c0 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ef87494ac766ee29ac872b495647f847c00c06d70808ba2dc5688ce5bde3eaee +size 550324768 diff --git a/Qwen2-Math-1.5B.i1-IQ2_XXS.gguf b/Qwen2-Math-1.5B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..16c6bae --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee7439c83698b4eed460b502e79721f6828e4d0050251702ed763caa0a97ff1e +size 511015456 diff --git a/Qwen2-Math-1.5B.i1-IQ3_M.gguf b/Qwen2-Math-1.5B.i1-IQ3_M.gguf new file mode 100644 index 0000000..d76e5d4 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:777704aeaa1daad175b4ed20bdccce9ad466d7af2e251a29103d6642b38d0a4d +size 776662048 diff --git a/Qwen2-Math-1.5B.i1-IQ3_S.gguf b/Qwen2-Math-1.5B.i1-IQ3_S.gguf new file mode 100644 index 0000000..50ffda6 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1746edf9febdf772084b03b0868efb6015ab261bc0d624930c5c4e93d4754e3 +size 762404896 diff --git a/Qwen2-Math-1.5B.i1-IQ3_XS.gguf b/Qwen2-Math-1.5B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..ab7616f --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:29b05baefad7f6e0e3b1b4a99d2ee1ae7b98676ed8b31168d3cae2c37239721f +size 731697184 diff --git a/Qwen2-Math-1.5B.i1-IQ3_XXS.gguf b/Qwen2-Math-1.5B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..c3d2148 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:86b540bee87fbd52f0699b2fe6d1e3beac4b3d5cf6766a11cf6cf34d24087d59 +size 668790304 diff --git a/Qwen2-Math-1.5B.i1-IQ4_NL.gguf b/Qwen2-Math-1.5B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..37e84bc --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4c252a0b2004e0789209d4cf974bc97c4cb71372b79f9090c4276b0750f43274 +size 936329248 diff --git a/Qwen2-Math-1.5B.i1-IQ4_XS.gguf b/Qwen2-Math-1.5B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..d20c5cf --- /dev/null +++ b/Qwen2-Math-1.5B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:11812e21f3a3feb46372dea9c3414b3e187a84ef91e74d7a27f880edda1022a5 +size 895729696 diff --git a/Qwen2-Math-1.5B.i1-Q2_K.gguf b/Qwen2-Math-1.5B.i1-Q2_K.gguf new file mode 100644 index 0000000..9d59c85 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6646e72e4ea68e5c4fd4cbe37bb9b39650075eca87b04818b38bc23edae4b3a1 +size 676302880 diff --git a/Qwen2-Math-1.5B.i1-Q2_K_S.gguf b/Qwen2-Math-1.5B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..0a8ebcf --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:92c59dc21073577d81902ab4cb19282e5fd3f6bf1c378483de98be7b1df76492 +size 640133152 diff --git a/Qwen2-Math-1.5B.i1-Q3_K_L.gguf b/Qwen2-Math-1.5B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..ed4fbdd --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cfa94ba167c8e9c17d6f77c0af9a360f6c1585a8bf60fb6640c788f8c9517a12 +size 880160800 diff --git a/Qwen2-Math-1.5B.i1-Q3_K_M.gguf b/Qwen2-Math-1.5B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..3a681ed --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5bd70245df3ea9450d8b7119477c8c557e2d29a7d9d82d68a1695358d0f6c2b8 +size 824176672 diff --git a/Qwen2-Math-1.5B.i1-Q3_K_S.gguf b/Qwen2-Math-1.5B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..7ce0b31 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5f6ca0b1812e8a9ab969366968481ea6b90a884a151092c2f254594a272bae58 +size 760942624 diff --git a/Qwen2-Math-1.5B.i1-Q4_0.gguf b/Qwen2-Math-1.5B.i1-Q4_0.gguf new file mode 100644 index 0000000..bafdf3a --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:09ca24a2416af198feeb79542eb016daedc69718ff4b4509a036790166985e58 +size 937533472 diff --git a/Qwen2-Math-1.5B.i1-Q4_1.gguf b/Qwen2-Math-1.5B.i1-Q4_1.gguf new file mode 100644 index 0000000..aa07f9a --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c3445e5a4b8fecd516aa36717552edd2605a6bc4cca27ef12de1f192ccb688d9 +size 1016840224 diff --git a/Qwen2-Math-1.5B.i1-Q4_K_M.gguf b/Qwen2-Math-1.5B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..512da43 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b77d5fa34f6e689105f88b8ef832f3d0d3ec8b3858c98530a5d50f7416c8f4f +size 986046496 diff --git a/Qwen2-Math-1.5B.i1-Q4_K_S.gguf b/Qwen2-Math-1.5B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..2f9af8c --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2047faea3d16350a6469daa6389f41ed499ef2ce715ee32434c53a77a7494328 +size 940310560 diff --git a/Qwen2-Math-1.5B.i1-Q5_K_M.gguf b/Qwen2-Math-1.5B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..f9f5185 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2d81fd6688e3776e1e85088ccb978984a1e436267c8ef521f7cdf9e18bf209e0 +size 1125048352 diff --git a/Qwen2-Math-1.5B.i1-Q5_K_S.gguf b/Qwen2-Math-1.5B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3086500 --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d714b423dbd3823005ae3bc2947583d014f3e54dc513910a67808f3d6179a0fb +size 1098727456 diff --git a/Qwen2-Math-1.5B.i1-Q6_K.gguf b/Qwen2-Math-1.5B.i1-Q6_K.gguf new file mode 100644 index 0000000..8d510cf --- /dev/null +++ b/Qwen2-Math-1.5B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ea25baf8f710bf0527d8aab110aea7b74bbb5d9767735aa24991dccbd7808f2a +size 1272737824 diff --git a/README.md b/README.md new file mode 100644 index 0000000..a3653ee --- /dev/null +++ b/README.md @@ -0,0 +1,78 @@ +--- +base_model: Qwen/Qwen2-Math-1.5B +language: +- en +library_name: transformers +license: apache-2.0 +quantized_by: mradermacher +tags: +- chat +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/Qwen/Qwen2-Math-1.5B + + +static quants are available at https://huggingface.co/mradermacher/Qwen2-Math-1.5B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2-Math-1.5B-i1-GGUF/resolve/main/Qwen2-Math-1.5B.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..b5f0c38 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:42b46c0a86a820fe130496c28044bb38673d31a0d3e366dfb34b7a68e8dc2508 +size 2042201