commit bbe280ba7b01ed2afb1145a708c12c04d8cbd25f Author: ModelHub XC Date: Mon Jul 20 06:31:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b4639f0 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-1.7B-Jailbreak-reasoning.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_M.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_M.gguf new file mode 100644 index 0000000..7c53cd9 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bed78749cfe19a2dac6c872cf0ac0534a6178e5ddd6529f16eda24875377da3b +size 543794464 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_S.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_S.gguf new file mode 100644 index 0000000..13d4cbd --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9e29fbdc3b8242aab33812fafdbeefa473c358ef9b84a183044fe6874bbb385 +size 515777824 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_M.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_M.gguf new file mode 100644 index 0000000..3321ace --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e87d082ba63b786c3851e9ff4e02804681506ae36b15e471e8731d94c4cd4dab +size 695182624 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_S.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_S.gguf new file mode 100644 index 0000000..00ee039 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a56c073eabda0f8d0df92f1be29f19675cdf4dcc8ed803ba8ca1ab7de9a6eb2 +size 657827104 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XS.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XS.gguf new file mode 100644 index 0000000..ef32068 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56b84c9d501da4610256d38ef9256d53713b4e619714b9f3512121247d294f65 +size 631514400 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XXS.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..dcf88a5 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc332a40ce0a90e1d59a4927b1a400c13ba6006e8c337073039218ef23b30725 +size 590488864 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_M.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_M.gguf new file mode 100644 index 0000000..bf30581 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9721a4a6893dcfeb06e05bbb20f6a257d23c5d342a0173354c80074c2daba923 +size 895663392 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_S.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_S.gguf new file mode 100644 index 0000000..2f345ab --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d354f862ddd9858040a8fe03afb7fc3e3900b21b022f774c88ecdd835e85e2c4 +size 867253536 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XS.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XS.gguf new file mode 100644 index 0000000..0f9e66d --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6d521aeb777d62dea59a9a96a92467282784a839ce452d488a8605eca34954bd +size 834223392 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XXS.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..2eb80f9 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1c2e4bdc7b3468f0e14f13e5d696d1f94553d4de93cdf9bda9a763b4aa3ec6ca +size 754361632 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_NL.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_NL.gguf new file mode 100644 index 0000000..c864498 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb591c0c5c0399db5c71f9c2d73ae671dd3b568e3f1bc7bd37190221b1bee86d +size 1054424352 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_XS.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_XS.gguf new file mode 100644 index 0000000..0b80eb5 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e1ee76c7e06de80844a9cb2603b98b770f6a9aa6f3d9bc964ee0cfb33fed2316 +size 1010384160 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K.gguf new file mode 100644 index 0000000..01aa333 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d7bda3782ca23f3786de779d3872742a23d06a553a789db06d7aeff6544c256d +size 777796896 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K_S.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K_S.gguf new file mode 100644 index 0000000..42f9211 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89e59f344112668f64d557248978f8d5c6cf1f81d181162f93d3ab5302991f2b +size 732970272 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_L.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_L.gguf new file mode 100644 index 0000000..9b7e197 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e24783a1336666d2d6a8563c2415e4fa17e2c166bae1468b0b572c7deae625e8 +size 1003502880 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_M.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_M.gguf new file mode 100644 index 0000000..48ffafe --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:de98aec06b242a23100af8607d040b8d9983a6ee8219cc6e8c29313293a86cb1 +size 939539744 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_S.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_S.gguf new file mode 100644 index 0000000..3331773 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f72bc087b43ec8d40352f4721618df83e2fc28a5152e43d18b761c3802dafd76 +size 867253536 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_0.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_0.gguf new file mode 100644 index 0000000..60901f4 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0f23ace5965e46bdbe05e707537af211b637c2e6ac4e914d6c7780d509d48ffd +size 1056783648 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_1.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_1.gguf new file mode 100644 index 0000000..19b8fe0 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9326367c1e3b2376d86002df800573396b0db48463e6fa4c243d53c2f1141281 +size 1142504736 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_M.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_M.gguf new file mode 100644 index 0000000..85dfa22 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c710db38bae02eaaa63e905b4df0fecd292b4c1edcab51fec6b5c55af49f926e +size 1107410208 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_S.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_S.gguf new file mode 100644 index 0000000..9c06bdd --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6e21d428dcf816d4c6744375a36477d4d89af65ecf9bd6d912cbd1d14718de8 +size 1060191520 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_M.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_M.gguf new file mode 100644 index 0000000..e9ada0e --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cd59ea340314f7b686dc491bbef755be66c7079eeba0696da6808b33019e21ac +size 1257880864 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_S.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_S.gguf new file mode 100644 index 0000000..74dd909 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93463e9b57de61ebaa4e91b790c4ce012ce577913d2aff85c0fef113ece51c2e +size 1230585120 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.i1-Q6_K.gguf b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q6_K.gguf new file mode 100644 index 0000000..9f70d8f --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ffa4cfe7050cf21a89575eeacc883a7d3aae230b6bd10d2f2a70c591cf50365e +size 1417755936 diff --git a/Qwen3-1.7B-Jailbreak-reasoning.imatrix.gguf b/Qwen3-1.7B-Jailbreak-reasoning.imatrix.gguf new file mode 100644 index 0000000..9b38283 --- /dev/null +++ b/Qwen3-1.7B-Jailbreak-reasoning.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c6a2d7bdc2b36378183864684c878a44b845f5cca75de986ff96d3d6acb80ef3 +size 2094560 diff --git a/README.md b/README.md new file mode 100644 index 0000000..ee10a87 --- /dev/null +++ b/README.md @@ -0,0 +1,90 @@ +--- +base_model: Sanraj/Qwen3-1.7B-Jailbreak-reasoning +datasets: +- Sanraj/jailbreaking-prompt-response-reasoning +language: +- en +library_name: transformers +license: mit +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- red-teaming +- agent +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Sanraj/Qwen3-1.7B-Jailbreak-reasoning + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-1.7B-Jailbreak-reasoning-i1-GGUF/resolve/main/Qwen3-1.7B-Jailbreak-reasoning.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +