commit 39ac9e5abbc46f56f6cba86a39d2b94ef428392f Author: ModelHub XC Date: Tue Jul 21 13:30:10 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ff1948c --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_M.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_M.gguf new file mode 100644 index 0000000..7cc5d0f --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b8060618fa5b2760cceddeed6c36929d1dc4248fa52732e2ee3e38ff3222ca23 +size 7078292896 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_S.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_S.gguf new file mode 100644 index 0000000..13f86b2 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d7005f4756f3bdb0bf181802709ee6bca96e500d70ec558f61fd9a48e582fcd +size 6416510368 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_M.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_M.gguf new file mode 100644 index 0000000..cbe9f77 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a25d25ea6f6a26e09de3ba7e44c19c6ac74150363847d377c76289cdabaff558 +size 10169509280 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_S.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_S.gguf new file mode 100644 index 0000000..e8ff231 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6ed258d2208428eb563fdeb2109b8fd78c92edba5a45ff0770cd24bfe193d81 +size 9287132576 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XS.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XS.gguf new file mode 100644 index 0000000..813a363 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4e613043947f9e130f4a11ea0e729bf381f259c18288e2653935fc170fa74161 +size 9076223392 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XXS.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..df0ae0a --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7792af308ddc2c6f492fbf15b12b713ae5660185a3c9ff168b5bab6d169c813e +size 8181263776 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_M.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_M.gguf new file mode 100644 index 0000000..459c296 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90e3465e9f7bbd0c726d2345866a874a62f52f86fbea6e3b3292f390e95d7960 +size 13513063840 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_S.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_S.gguf new file mode 100644 index 0000000..af33666 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a6abfd8eedae4988d3247dbfa188bc6bb4e53fc537db3f3353bd79d1e9f2d438 +size 13299154336 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XS.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XS.gguf new file mode 100644 index 0000000..1d5363c --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:138af3cf598491d34564b479850487db20cc4b3dfa9539736f10f65543fe0752 +size 12598443424 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XXS.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..d317e8e --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bcda30a4324c22a354c5e07e0694a5101acfdab6f3d87487ebddf5bbd3ea8fab +size 11849328032 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ4_XS.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ4_XS.gguf new file mode 100644 index 0000000..ec33f7f --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1b9138c1d94716d987304049f634817c70e9f87af1dbaf96b2c28b1d6a76e460 +size 16368350624 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K.gguf new file mode 100644 index 0000000..8cde6f5 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f59b8a217443e87b57b46f4236c534de0f9ec7b9c1b3f9500cfa820e128c088b +size 11258611104 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K_S.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K_S.gguf new file mode 100644 index 0000000..d5b0228 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24ae7635048f5eb0b09bb3c1f07ae299649e3f96f3e50ec479465d6049951326 +size 10519365024 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_L.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_L.gguf new file mode 100644 index 0000000..0b2fcd1 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:df1cfe9aba26c777deacb032d22db57c442b1127542f843e9b9d9579534e3bc6 +size 15900671392 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_M.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_M.gguf new file mode 100644 index 0000000..d66eec4 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:27ae237e600401fdbed4a749adbdfeba7b9960bcdeb4d64e6e582a8c98190cd7 +size 14711848352 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_S.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_S.gguf new file mode 100644 index 0000000..bce7071 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:676042d0ef4bdc9b27d21d799fc6812d23ea16a7e55d1b7cc3325a8f86780ea2 +size 13292469664 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_0.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_0.gguf new file mode 100644 index 0000000..7163861 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c33564fad08730aa6fed468f1635c6ce50145681918b6dc2018dcd86b3489c3 +size 17379988896 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_1.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_1.gguf new file mode 100644 index 0000000..c5ff95b --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0d633976489637af42881b3faeed9b3202bbb8037d0301f79d9f2cec19109981 +size 19192501664 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_M.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_M.gguf new file mode 100644 index 0000000..7ded8d7 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c86e033ec2282d07c810320960ce0a67394fd526dc91fd90a5f5c7a0014282a5 +size 18556687776 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_S.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_S.gguf new file mode 100644 index 0000000..1810162 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d3c684b7b6f6ac3593de3d0f6977636a49fdfccc0054503d3b349d7e51c37118 +size 17456010656 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_M.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_M.gguf new file mode 100644 index 0000000..312a6c2 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c5c1a5c5de82251fe63dbcc6b338453ad7b23326ecacd92245068c2bb028bc9e +size 21725582752 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_S.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_S.gguf new file mode 100644 index 0000000..4c7f9c1 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:94895479cd264bd10b0679d2a173aea00ad7db3047cbc1c569fd479474de8a50 +size 21080511904 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q6_K.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q6_K.gguf new file mode 100644 index 0000000..072c47e --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:178d71a3844ef9048149c6dd3f93e1652f29624b2ec1a87e29a9c36e4e95131c +size 25092533664 diff --git a/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.imatrix.gguf b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.imatrix.gguf new file mode 100644 index 0000000..1b10250 --- /dev/null +++ b/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:49c54847fdc045521af36e8d4e260efcf219d5cd00e269ce577aeb805c1fcbcc +size 122029312 diff --git a/README.md b/README.md new file mode 100644 index 0000000..e949b7c --- /dev/null +++ b/README.md @@ -0,0 +1,97 @@ +--- +base_model: DavidAU/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8 +datasets: +- TeichAI/gemini-3-pro-preview-high-reasoning-250x +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- finetune +- unsloth +- Gemini 3 pro reasoning +- reasoning +- thinking +- distill-fine-tune +- moe +- 128 experts +- 256k context +- mixture of experts +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.imatrix.gguf) | imatrix | 0.2 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_S.gguf) | i1-IQ1_S | 6.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ1_M.gguf) | i1-IQ1_M | 7.2 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 8.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_XS.gguf) | i1-IQ2_XS | 9.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_S.gguf) | i1-IQ2_S | 9.4 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ2_M.gguf) | i1-IQ2_M | 10.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K_S.gguf) | i1-Q2_K_S | 10.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q2_K.gguf) | i1-Q2_K | 11.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 11.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_XS.gguf) | i1-IQ3_XS | 12.7 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_S.gguf) | i1-Q3_K_S | 13.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_S.gguf) | i1-IQ3_S | 13.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ3_M.gguf) | i1-IQ3_M | 13.6 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_M.gguf) | i1-Q3_K_M | 14.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q3_K_L.gguf) | i1-Q3_K_L | 16.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-IQ4_XS.gguf) | i1-IQ4_XS | 16.5 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_0.gguf) | i1-Q4_0 | 17.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_S.gguf) | i1-Q4_K_S | 17.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_K_M.gguf) | i1-Q4_K_M | 18.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q4_1.gguf) | i1-Q4_1 | 19.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_S.gguf) | i1-Q5_K_S | 21.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q5_K_M.gguf) | i1-Q5_K_M | 21.8 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8-i1-GGUF/resolve/main/Qwen3-30B-A3B-Gemini-Pro-High-Reasoning-2507-HI8.i1-Q6_K.gguf) | i1-Q6_K | 25.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +