commit 6e1351c00a79013f84552689c086b07c284a8804 Author: ModelHub XC Date: Thu Apr 23 14:31:34 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..f252185 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_M.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_M.gguf new file mode 100644 index 0000000..f4b0f79 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f850ea0e4fb21c941e6307c4ca90e51f6cac3f92333521f788f5239f5db0336 +size 1704889856 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_S.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_S.gguf new file mode 100644 index 0000000..7d313b1 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b8862094e42dabd3124075651236b8034bf40a81abc37a962269fafc98c72b00 +size 1595188736 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_M.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_M.gguf new file mode 100644 index 0000000..369402b --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:68c3ae245f48776c7c1d071563c05b6b5897347e251cb6b52d335585c1414d8c +size 2334063616 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_S.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_S.gguf new file mode 100644 index 0000000..ecbdc06 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bc898a4fecce8f4aa0705fe47fba519acb886b5b118855d4421ec1ccba338df1 +size 2187795456 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XS.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..d62d188 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a92fad69c9f3ac72dfe61ed375261e457c128586f3f089b29d63fcf371c48878 +size 2052015616 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XXS.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..439dc28 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2fd7f5917abb78b40450afa4d17b7661857226a323de5416747aa703b3f4a724 +size 1887725056 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_M.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_M.gguf new file mode 100644 index 0000000..d52bdd6 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9805703fa0289f1cb4aa5a198a7f60476e91e8057d63a6dabf9dce3bc55aeda2 +size 2994100736 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_S.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_S.gguf new file mode 100644 index 0000000..adaeb14 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:461fea3ec46477b021778f9efd52f3410263eead6c08a907d80556d51d61fff0 +size 2897660416 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XS.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..c4c59fc --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d59ac70cbfc71aa24daa5783d955a83a77fe5e6eded5d94d30bd6f53113134ab +size 2765810176 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XXS.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..081fd44 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5385d5e56ab3adc2fb161e9eb95819f8ac5d22d13e9d8bc771fd2634e882a5ad +size 2574539776 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_NL.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..1378c4e --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ded72af8974af844060b1c443dd9cecc87ddacb3e48ddabe85911c4c1d05683 +size 3685421056 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_XS.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..d555edf --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa0b5ce23fb405e2f39c1d43db1956939f808d16cc2204fbd64690bdca09524d +size 3504306176 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K.gguf new file mode 100644 index 0000000..bed03db --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:11c58d7738cc6253435985224f2c9bc88cfe8a3b5a2cee6beb75b2ee4e531ed6 +size 2506720256 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K_S.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..6a5bace --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:663bd987ece7849c43307cf59d056b6edf9417dd75526452bf0dd4697350cc41 +size 2344057856 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_L.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..7d63cbe --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7adc23ad1e61fbaee6b259e7701816feadae24de1865e683264b48dbb4015a6d +size 3417494016 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_M.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..9ec33d4 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aefc8066165921b9fdea8c9f3cc04c583a992cdbb9b5d05e70a5a7e5ac92e630 +size 3166163456 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_S.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..99d812b --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d4da9af7ffc839eaf6e233900eb78defc0379f21c7e75c3b5a42a7646807343d +size 2878511616 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_0.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_0.gguf new file mode 100644 index 0000000..9e36000 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b99955057baeacc2161d62621ec520a21719a413a32f247c006358f85600cbfb +size 3676737536 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_1.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_1.gguf new file mode 100644 index 0000000..e9030fe --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a334b04d3bb2f98ff11273320a83a9624fa85a3056f8f49e3eec5c0a14f18e54 +size 4038639616 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_M.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..4ba105e --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af5809487f0bca2fb91616046af7078b97fcaec9f16faa5b53fb53f18a1a806b +size 3858999296 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_S.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..9b0f1bd --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17a1f4fe0087498f09737fb6266f7a983766b2dee7efb4a9efe4199e2898ae11 +size 3687387136 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_M.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..2b47c14 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c0a054e72f2f7531560af6032ef422545f04069e08bd12c2e4155cdfce0f6cb6 +size 4508583936 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_S.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3cb011e --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4eb8d184b961af3fc58b347f496943e479dbeb5360e2347ccfd562cdbee20235 +size 4409880576 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q6_K.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q6_K.gguf new file mode 100644 index 0000000..f66d64a --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0f63163218e1b946b2e9cc3c0561a0a380f2fb63b0a413b5c1b92e965221d59c +size 5198767616 diff --git a/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.imatrix.gguf b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.imatrix.gguf new file mode 100644 index 0000000..989bac1 --- /dev/null +++ b/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:196279b2e43540c11bc4edc6435a7c8a944948eb8fea1de22336bd3cd37c00b9 +size 5916480 diff --git a/README.md b/README.md new file mode 100644 index 0000000..f75a877 --- /dev/null +++ b/README.md @@ -0,0 +1,112 @@ +--- +base_model: DavidAU/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- programming +- code generation +- code +- coding +- coder +- chat +- code +- chat +- brainstorm +- qwen +- qwen3 +- qwencoder +- brainstorm 20x +- creative +- all uses cases +- Jan-V1 +- Deep Space Nine +- DS9 +- horror +- science fiction +- fantasy +- Star Trek +- finetune +- thinking +- reasoning +- unsloth +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.8 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ2_M.gguf) | i1-IQ2_M | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q2_K.gguf) | i1-Q2_K | 2.6 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.7 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.3 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_0.gguf) | i1-Q4_0 | 3.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 3.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 3.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q4_1.gguf) | i1-Q4_1 | 4.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.5 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 4.6 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B-i1-GGUF/resolve/main/Qwen3-ST-Deep-Space-Nine-v3-256k-ctx-6B.i1-Q6_K.gguf) | i1-Q6_K | 5.3 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +