commit 31a059550aaf1e5cecc0e01d61ddd5c7dc461ded Author: ModelHub XC Date: Thu Aug 20 02:47:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/QwQ-MathOct-7B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..35d6921 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +QwQ-MathOct-7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/QwQ-MathOct-7B.i1-IQ1_M.gguf b/QwQ-MathOct-7B.i1-IQ1_M.gguf new file mode 100644 index 0000000..97470ae --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c2ff8da24ed8d853b9b309f0bd5b77cc6c7a7e6f6897b9368f3f45ca51550f74 +size 2042197088 diff --git a/QwQ-MathOct-7B.i1-IQ1_S.gguf b/QwQ-MathOct-7B.i1-IQ1_S.gguf new file mode 100644 index 0000000..490accf --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7433d57de2746fe751f1a569a241a01b771b1a5ae4313260163775b18f224a50 +size 1903668320 diff --git a/QwQ-MathOct-7B.i1-IQ2_M.gguf b/QwQ-MathOct-7B.i1-IQ2_M.gguf new file mode 100644 index 0000000..6d11ca7 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:06dc07c6c85a1c08e1d6ed1d4e8265edd13a720e72ff3da955571e5b16de3e5a +size 2780343392 diff --git a/QwQ-MathOct-7B.i1-IQ2_S.gguf b/QwQ-MathOct-7B.i1-IQ2_S.gguf new file mode 100644 index 0000000..a778967 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ba32eedecbbfe7b9cc01b6bd4257c42e7b26148fb2b69b0885d10fedc3b44efa +size 2595638368 diff --git a/QwQ-MathOct-7B.i1-IQ2_XS.gguf b/QwQ-MathOct-7B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..7625f8f --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d4c49f141f0cfdcdc98b8216cab6dca5d18d131784ed54346a60414e2b4c2cd5 +size 2469022816 diff --git a/QwQ-MathOct-7B.i1-IQ2_XXS.gguf b/QwQ-MathOct-7B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..f5726a9 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9dc96d960038c868ba3bc3a2497fd4c18ab95db35d82f419b77d8df49ac00bad +size 2273078368 diff --git a/QwQ-MathOct-7B.i1-IQ3_M.gguf b/QwQ-MathOct-7B.i1-IQ3_M.gguf new file mode 100644 index 0000000..641b453 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:270608a7df66fdac49c5531ed9471bcfaab1ca1ba235d36c25558f20fd67277c +size 3574013024 diff --git a/QwQ-MathOct-7B.i1-IQ3_S.gguf b/QwQ-MathOct-7B.i1-IQ3_S.gguf new file mode 100644 index 0000000..c859085 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3238cff8b3cc0c951c530d5e42a5940c2d5a5634a3a386ebd74385bd5a299bfc +size 3499193440 diff --git a/QwQ-MathOct-7B.i1-IQ3_XS.gguf b/QwQ-MathOct-7B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..db4ce5f --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2344cb83fac48b9d1126c6d33a7559e5553dc1064ce9d388952a26d501c386cc +size 3346256992 diff --git a/QwQ-MathOct-7B.i1-IQ3_XXS.gguf b/QwQ-MathOct-7B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..cadda14 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b5d88888a137966b6f76276a775a0705ff62507ba366e910b13eb200f5a16e5 +size 3114515552 diff --git a/QwQ-MathOct-7B.i1-IQ4_NL.gguf b/QwQ-MathOct-7B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..21061b5 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:792a0d88a0a746d8912238ec042a7feac13edab11462c8decc0a7f962dfe4396 +size 4437814368 diff --git a/QwQ-MathOct-7B.i1-IQ4_XS.gguf b/QwQ-MathOct-7B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..0372ce5 --- /dev/null +++ b/QwQ-MathOct-7B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89bf4153cb19979381fddca559c79a1eb212104e5deae5685af9ce5765c3265f +size 4218473568 diff --git a/QwQ-MathOct-7B.i1-Q2_K.gguf b/QwQ-MathOct-7B.i1-Q2_K.gguf new file mode 100644 index 0000000..dd2b39c --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b41ccc23813d4e8807c2b7a111a12af3699d3358e7d908b7ac58229cd4106a64 +size 3015941216 diff --git a/QwQ-MathOct-7B.i1-Q2_K_S.gguf b/QwQ-MathOct-7B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..47bfe68 --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d376a7df8b77cde9c95ce249148543547f32fc753a0949506fa36a254d09705b +size 2834074720 diff --git a/QwQ-MathOct-7B.i1-Q3_K_L.gguf b/QwQ-MathOct-7B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..fd150ed --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a396146aa8863583421f3eba20db547921e4635336a059e734fa210f18a8ff54 +size 4088460384 diff --git a/QwQ-MathOct-7B.i1-Q3_K_M.gguf b/QwQ-MathOct-7B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..936b3c9 --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b556b6f191cae1375489ff7d7c079be24be958989602fd3b1580c9accbdd941 +size 3808392288 diff --git a/QwQ-MathOct-7B.i1-Q3_K_S.gguf b/QwQ-MathOct-7B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..8ce2950 --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f62c5293d1e0c730b99878e22c379e4385907f484a86a5f9893ae4609572a03 +size 3492369504 diff --git a/QwQ-MathOct-7B.i1-Q4_0.gguf b/QwQ-MathOct-7B.i1-Q4_0.gguf new file mode 100644 index 0000000..69f397d --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:528051f6ede5feb2e414b509c74e313e1113cb25de8418478e28a4baeb190a92 +size 4444122208 diff --git a/QwQ-MathOct-7B.i1-Q4_1.gguf b/QwQ-MathOct-7B.i1-Q4_1.gguf new file mode 100644 index 0000000..5d3abf0 --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:92da696d0f0175dac151a55106d01a4fc9204d8c33b885733d27935950de6b3e +size 4873284704 diff --git a/QwQ-MathOct-7B.i1-Q4_K_M.gguf b/QwQ-MathOct-7B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..6d7db0c --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:27fa8b6bb101c5d4c2dc7bab3aade890f16fe1e743ae59038b5e65b12563e1b6 +size 4683074656 diff --git a/QwQ-MathOct-7B.i1-Q4_K_S.gguf b/QwQ-MathOct-7B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..dbc5dd5 --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c46996fac24165f740e61442324b32c0cc2834c75cfcf828d86e72444701eeb +size 4457770080 diff --git a/QwQ-MathOct-7B.i1-Q5_K_M.gguf b/QwQ-MathOct-7B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..65336e1 --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1c6f4f24366c0c9223515d8e7790d3379656d6285d2720d79915e1979fa659fa +size 5444832352 diff --git a/QwQ-MathOct-7B.i1-Q5_K_S.gguf b/QwQ-MathOct-7B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..c83d9c9 --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:345ec56d11d22d7ac2cd29964b8b9c50a433a3ca25af60a94e2d87042f4d399a +size 5315177568 diff --git a/QwQ-MathOct-7B.i1-Q6_K.gguf b/QwQ-MathOct-7B.i1-Q6_K.gguf new file mode 100644 index 0000000..d9abc2b --- /dev/null +++ b/QwQ-MathOct-7B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4a9e5bd73839e62802f8d7700c65cf1a5705e60d118cb4948aa7852d322b6d4d +size 6254199904 diff --git a/README.md b/README.md new file mode 100644 index 0000000..779c2d2 --- /dev/null +++ b/README.md @@ -0,0 +1,81 @@ +--- +base_model: prithivMLmods/QwQ-MathOct-7B +language: +- en +library_name: transformers +license: apache-2.0 +quantized_by: mradermacher +tags: +- text-generation-inference +- qwen2.5 +- qwq +- math +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/prithivMLmods/QwQ-MathOct-7B + + +static quants are available at https://huggingface.co/mradermacher/QwQ-MathOct-7B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | | +| [GGUF](https://huggingface.co/mradermacher/QwQ-MathOct-7B-i1-GGUF/resolve/main/QwQ-MathOct-7B.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..a05db68 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b7ffc89f032a3eb5ee0de3f362ec6a73b482864914c2eb602a4e0695598cf528 +size 4536665