commit 3edb54abccebce781c13380362593775fddfcb25 Author: ModelHub XC Date: Sun Aug 9 18:35:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..42c7a54 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_M.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_M.gguf new file mode 100644 index 0000000..12042c9 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5211386f997dee943a7b0b581a7fd252685f6352447967e84d93ebb6441b61e3 +size 540608832 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_S.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_S.gguf new file mode 100644 index 0000000..0f9d711 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:72492f86f4a456507e2cccbdec2ed11d18335078b7fe3b023cdc8b1f6504f3b2 +size 512675136 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_M.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_M.gguf new file mode 100644 index 0000000..bcbdd59 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:55ddf3ae711e8b86cea114ec33858c17f4a45b2a83ebd251d7ea73d477313a0b +size 700861984 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_S.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_S.gguf new file mode 100644 index 0000000..91d9de7 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ddab67d3a9d67bb83f02ec56cc13e16f59b0b0be6f7790895fdd262f819c16ba +size 663617056 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XS.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XS.gguf new file mode 100644 index 0000000..b664280 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61ec6f990c5c7a4dd7c90d43e4404f7bbcd1bddb8fb5943ee7214c2d7e4fbe48 +size 626474304 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XXS.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..4ad9a8a --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4bd11706fecae1a283851bf9131e395a128a0610bd5d08dfea7d4b5e3e65d828 +size 587164992 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_M.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_M.gguf new file mode 100644 index 0000000..8038621 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0e5d37baa74f2f582ce1ca76b3613da9be5001fe7e78a4a2d664da26218f0a4f +size 876416064 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_S.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_S.gguf new file mode 100644 index 0000000..1d55a7d --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a356b6b2c04cc75c77fb8b5b37e7ecc573990facc453d8f06baca1564633a81b +size 862158912 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XS.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XS.gguf new file mode 100644 index 0000000..b5a087c --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:805d84e4d5067fbe2da65a8cbda8532967c4a44c0df5d4f96ce5e517b83e5153 +size 831451200 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XXS.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..dbd3b22 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8c8869cf7f981e620bdde1b889853ae88b1b34c8fc77b4c8910647b859948b95 +size 768599584 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_NL.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_NL.gguf new file mode 100644 index 0000000..7d70385 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:168ffad90901c418a0772710a436f9fa7e6691d6eef8106fe09c3becec5228b3 +size 1067022912 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_XS.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_XS.gguf new file mode 100644 index 0000000..a340e58 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c1dc25d2aba37696a042785e65e9e18de69af900a18ea80156073e56e88417c3 +size 1019143456 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K.gguf new file mode 100644 index 0000000..b698686 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16d9638de76e7b6632d87458b0e4b3c6cb6c54cdbb69abf4f93cf674886fb4d4 +size 752397152 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K_S.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K_S.gguf new file mode 100644 index 0000000..d5a660e --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24cf327f1b4f4e7b04296d3242dc7117bb99327cd1dfe507f575e847a5d1e7bc +size 716227424 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_L.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_L.gguf new file mode 100644 index 0000000..a071f6e --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5453331b214dc48e5751521d68b161c9a7f50e093fd07e24867bed00d9d8062b +size 979914816 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_M.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_M.gguf new file mode 100644 index 0000000..6fae0f3 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2fb92685562c06f0ce94a2b95330fd41017b4ceee2f36f68a07b95f16178850e +size 923930688 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_S.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_S.gguf new file mode 100644 index 0000000..fcbd889 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c469a445949671a6c4693776e1105286176a8ad62006c672e0c0e55ad014abe7 +size 860696640 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_0.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_0.gguf new file mode 100644 index 0000000..f2dc486 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ba31e7e891cde9e4866e3e9eec96a9a00611d0441e4565bf691cc517b16b6fb7 +size 1068227136 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_1.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_1.gguf new file mode 100644 index 0000000..647189a --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:409114d25df3fe579fead1300e12ebff13bbc7fbff335dbca9e6af294f1fd1ee +size 1162093728 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_M.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_M.gguf new file mode 100644 index 0000000..d17abc9 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f2f74b308200feab9e1867de090fe0dbd2f044b225ac80663fce78a9400c7d0 +size 1116740160 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_S.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_S.gguf new file mode 100644 index 0000000..da263a3 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:03c046606ac770c333073a06c8b9b4fa66fe5d7557b1a01ad4f13ae90eff6165 +size 1071004224 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_M.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_M.gguf new file mode 100644 index 0000000..afea78d --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:85dbdf7430db46885484ff0d084a5f78ceed6802e03985a41cb5de9f005310e7 +size 1284861696 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_S.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_S.gguf new file mode 100644 index 0000000..ead1c33 --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:34ead9a219d98a0056dac53576f20a6df4e0ec8898aa49fd54b4b58460b91847 +size 1258540800 diff --git a/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q6_K.gguf b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q6_K.gguf new file mode 100644 index 0000000..af7f75f --- /dev/null +++ b/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:49d3ad42747e283b5432329eec3c22d0ddc5d983ac8c201e7c7f351bd5ee468a +size 1463490848 diff --git a/README.md b/README.md new file mode 100644 index 0000000..7675c1d --- /dev/null +++ b/README.md @@ -0,0 +1,80 @@ +--- +base_model: nicoboss/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored +datasets: +- Guilherme34/uncensor +language: +- en +library_name: transformers +license: mit +quantized_by: mradermacher +tags: +- generated_from_trainer +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/nicoboss/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored + + +static quants are available at https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Fully-Uncensored.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..bb5c9b0 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5b864b2c3f4e26ebc6f4b4c52c145b5daea078666d84452170afd45ba7af786c +size 2042201