commit bc42a90566f7e73572f63981f66a7125f3bbfaa4 Author: ModelHub XC Date: Wed Jul 22 01:52:10 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..c35f67f --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_M.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_M.gguf new file mode 100644 index 0000000..ef1ab7f --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16606e59a28d170fd160aebc19cd459393ade576cc53cbbd5084568a386fc194 +size 7723144352 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_S.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_S.gguf new file mode 100644 index 0000000..0b779fd --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c3efc3d031b7fc5721cc35ba004762e9893df70734b2754b9eecc009d0871428 +size 6983652512 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_M.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_M.gguf new file mode 100644 index 0000000..aa53a42 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3cd2ec67a31bb041696464e19814b77f3832bd6cf2f096c8ce9950960d9e73b7 +size 11113895072 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_S.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_S.gguf new file mode 100644 index 0000000..6903f67 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c04d06516466cfa49637cd7e33856622c6d164cb5ac22b68f87fbd1f75e810b9 +size 10127905952 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XS.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XS.gguf new file mode 100644 index 0000000..5781796 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:68d0fb8dc0edb0d5438f9a8e66aee4b32ecc2f1b920a6c802e0f29160d724416 +size 9953416352 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XXS.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..081de08 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:590b02e12d852deda6db7bedebc723511cf320f6b184453fb24f50fda416246a +size 8955630752 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_M.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_M.gguf new file mode 100644 index 0000000..22da430 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5528eb8ffd9e9bc4228bc5c3b3d3497afb3dfff0f4593abb8005c31be86e942e +size 14825411232 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_S.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_S.gguf new file mode 100644 index 0000000..d08145c --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ebd0ee48058afa4bc697c6ac2a00d034f17ffcb0b2aba2864c112d2a3d8040a +size 14616515232 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XS.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XS.gguf new file mode 100644 index 0000000..c053eba --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1eb767713e5bbdf168e708419d8e31ed73335b92cb89925bd0fa23e2b40302a4 +size 13837947552 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XXS.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..41ca9f8 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93e04a614b5f7994e5599e718631f3ad2ff3fbf4b6ce7bd7e6840670e71ea15e +size 13000348832 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ4_XS.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ4_XS.gguf new file mode 100644 index 0000000..a5f68a0 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:054b168af6f90c7c2462679490d11e94b24e790b6e0be38d2a62a79922f16204 +size 17992520352 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K.gguf new file mode 100644 index 0000000..7918868 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1d9bd81f8aab35b57fff49a7dce5cf1b297b42f9780e0f8f637977f756dbfdfb +size 12383294112 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K_S.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K_S.gguf new file mode 100644 index 0000000..dcae602 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d38998573bb5e8f96df6f2b10c72af7924dff056bf6468ba2d206cabbffc28cb +size 11532472992 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_L.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_L.gguf new file mode 100644 index 0000000..d43c26c --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8d2d239712bf2a5c0ea8257a8e3282056c74c774857e6178bd864bcd464f8702 +size 17499280032 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_M.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_M.gguf new file mode 100644 index 0000000..17a24be --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eaf123c8ec5580ae230e41f89259b1e459fee4ec7ec950c29f026b54d72df65f +size 16170865312 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_S.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_S.gguf new file mode 100644 index 0000000..1fd2338 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d5cf0772cee216f366084bde7568071e06dea147d896e9cfec6568f517285794 +size 14603981472 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_0.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_0.gguf new file mode 100644 index 0000000..79a3f44 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:80a98c0309609b7a53a5e880656b8bbb9faebd28ca67dcc7a1337ae5c7c795af +size 19090576032 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_1.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_1.gguf new file mode 100644 index 0000000..1fb867c --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:781bbed756cc9bf6c9e024dff65ecbbf9b84337d866cf788c1c7a825479e65e5 +size 21092045472 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_M.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_M.gguf new file mode 100644 index 0000000..03288ec --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c95308c51f08bdbedd22c6dd3d51cfaf5a796d7ad3c9e678e5f5e173c480a7e1 +size 20414853792 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_S.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_S.gguf new file mode 100644 index 0000000..64652a9 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61db6060b90527d3b14227bc4856f28dd184448ece4086bf97866104bb620626 +size 19166597792 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_M.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_M.gguf new file mode 100644 index 0000000..0134363 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5e45fec56a8ac804a30cc00f271f16786ae6343e4f40f593648659a3e9ebea0b +size 23888917152 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_S.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_S.gguf new file mode 100644 index 0000000..6ad5a16 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4a4ba55f23171de75b80e98112498b4d85a9f5ddfb850169b3e51a3c32085ad +size 23168225952 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q6_K.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q6_K.gguf new file mode 100644 index 0000000..0ef4b33 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65519b95f2199c196c9d49d24147bdab5a22ef7859cd45fc4954ab7c0447b7dd +size 27580109472 diff --git a/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.imatrix.gguf b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.imatrix.gguf new file mode 100644 index 0000000..a30da52 --- /dev/null +++ b/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0e5efd37cdfec449fe8b0ec49568f1511082d1d4d84569d63b5f3e0b6e4a6dea +size 27772608 diff --git a/README.md b/README.md new file mode 100644 index 0000000..d2ef71b --- /dev/null +++ b/README.md @@ -0,0 +1,108 @@ +--- +base_model: DavidAU/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- 256k context +- Qwen3 +- Mixture of Experts +- MOE +- MOE Dense +- 2 experts +- 4Bx12 +- All use cases +- bfloat16 +- merge +- thinking +- reasoning +- GPT-5.1-High-Reasoning-Distill +- Gemini-3-Pro-Preview-High-Reasoning-Distill +- Claude-4.5-Opus-High-Reasoning-Distill +- Claude-Sonnet-4-Reasoning-Distill +- Kimi-K2-Thinking-Distill +- Gemini-2.5-Flash-Distill +- Gemini-2.5-Flash-Lite-Preview-Distill +- gpt-oss-120b-Distill +- GLM-Flash-4.6-Distill +- Open-R1-Distill +- Command-A-Reasoning-Distill +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_S.gguf) | i1-IQ1_S | 7.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ1_M.gguf) | i1-IQ1_M | 7.8 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_S.gguf) | i1-IQ2_S | 10.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ2_M.gguf) | i1-IQ2_M | 11.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q2_K.gguf) | i1-Q2_K | 12.5 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 13.1 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.7 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_S.gguf) | i1-IQ3_S | 14.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ3_M.gguf) | i1-IQ3_M | 14.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.3 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-IQ4_XS.gguf) | i1-IQ4_XS | 18.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_0.gguf) | i1-Q4_0 | 19.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_S.gguf) | i1-Q4_K_S | 19.3 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_K_M.gguf) | i1-Q4_K_M | 20.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q4_1.gguf) | i1-Q4_1 | 21.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_S.gguf) | i1-Q5_K_S | 23.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q5_K_M.gguf) | i1-Q5_K_M | 24.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill-i1-GGUF/resolve/main/Qwen3-48B-A4B-Savant-Commander-GATED-12x-Closed-Open-Source-Distill.i1-Q6_K.gguf) | i1-Q6_K | 27.7 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +