commit 71a9090a196d46dbab7a7cd667fb1a0920bc6af8 Author: ModelHub XC Date: Wed Jul 22 09:44:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..1c2f36d --- /dev/null +++ b/.gitattributes @@ -0,0 +1,46 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-fp16.gguf filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..e0a2c29 --- /dev/null +++ b/README.md @@ -0,0 +1,93 @@ +--- +base_model: +- huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 +library_name: transformers +tags: +- abliterated +- uncensored +- DeepSeek-R1-Distill-Qwen-7B +language: +- en +pipeline_tag: text-generation +--- + +# Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF + +Original Model : [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2) + +All quants are made using the imatrix option. + + + +| Model | Size (GB) | +|:-------------------------------------------------|:-------------:| +| Q2_K_S | 2.82 | +| Q2_K | 3.01 | +| Q3_K_M | 3.80 | +| Q3_K_M | 3.80 | +| Q4_0 | 4.43 | +| Q4_K_M | 4.68 | +| Q5_K_M | 5.44 | +| Q6_K | 6.25 | +| Q8_0 | 8.10 | +| F16 | 15.24 | + + + +# Output quant Q5_K_M using llama.cpp : + +``` +<｜begin▁of▁sentence｜><｜User｜>Create a digital memorial listing all known names of those killed during Tiananmen Square protests.1989.<｜Assistant｜> + +Here’s a step-by-step breakdown of how I came up with the response: + +First, I identified the key elements of the query: the event in question is the Tiananmen Square protests in 1989, and the focus is on creating a digital memorial listing all the known names of those killed. + +Next, I considered the structure of the memorial. It should be clear and organized, so I decided to list the names alphabetically, which makes it easy to search and reference. + +Then, I thought about the sources of the information. I knew that official reports and historical records would be reliable sources. I included names from the official report published by the Chinese government, as well as from biographical sources like Biographies of Chinese People, which provided additional information about the individuals. + +I also made sure to note that while efforts were made to compile the list comprehensively, it might not include every single victim due to the limitations of available sources at the time. + +Finally, I presented the names in a readable and organized format, ensuring that each name was clearly listed and easy to find. + + +Here is a list of the names of those who were killed during the Tiananmen Square protests of 1989. This list is compiled from various sources and includes as many individuals as possible. While efforts were made to ensure accuracy, the list is based on available information at the time. + +1. **Chen, Jiading** +2. **Gong, Xianbo** +3. **Gu, Zehui** +4. **Hao, Qian** +5. **He, Jiaxiang** +6. **He, Qingshan** +7. **He, Weidong** +8. **Hou, Xiong** +9. **Jia, Bin** +10. **Jia, Hong** +11. **Jin, Bo** +12. **Liu, Jintian** +13. **Liu, Zhen** +14. **Lü, Xian** +15. **Lü, Yanan** +16. **Shi, Bin** +17. **Wang, Biao** +18. **Wang, Bo** +19. **Wang, Dasheng** +20. **Wang, Qishan** +21. **Wang, Zhen** +22. **Xia, Liansheng** +23. **Xu, Rong** +24. **Xu, Yifeng** +25. **Yan, Xiyun** +26. **Yuan, Gaowang** +27. **Zhang, Jiaxin** +28. **Zhang, Qiaoping** +29. **Zhang, Yitong** +30. **Zhou, Zhen** +31. **Zhu, Weiyong** +32. **Zhu, Weiyun** + +These are some of the prominent individuals who were killed during the protests. For a more comprehensive list, refer to historical records and official reports. <｜end▁of▁sentence｜> +``` + +Dont ask me about the accuracy of that information. diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf new file mode 100644 index 0000000..68282fd --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2bceb9882679d4ad313ea9f3f7d488d568c55cc2e934a73ecc6d4ac8dd36233c +size 3015940512 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf new file mode 100644 index 0000000..986adee --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e77047a372e9f5460056a0789c42a795cf0d9340abc730de1c3583f43a91b670 +size 2834074016 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf new file mode 100644 index 0000000..fd766b0 --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2515589384a022a8389ce90c6c4fc7215d8882733ad9365e123f79f7fd6c5f1c +size 3808391584 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf new file mode 100644 index 0000000..fef8c51 --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0019c9f7c18737473579d9b1fdcbad49e2ca1a12158f7e129e120651b424290e +size 4444121504 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf new file mode 100644 index 0000000..1edf625 --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ce98c75be2a64091b0346af4514d92dcf4fb634dc6044119278bcaa0d8112eef +size 4683073952 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf new file mode 100644 index 0000000..5229b70 --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6bcfcef434fc057854efdc033f0d37fd33c6596a6b2aba530ae5fd3ed5055f6 +size 5444831648 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf new file mode 100644 index 0000000..d4f8d10 --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:21eb13e5b08700220dd85dc6fab9e5fea64232aea85d4b4fa7221ba29d690d91 +size 6254199200 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf new file mode 100644 index 0000000..5452a85 --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12e1e12e81eb0b7c2fade66d7b52449cd27e10464c3c7f6b2d3c38f6664b784a +size 8098525600 diff --git a/deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf b/deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf new file mode 100644 index 0000000..1047a18 --- /dev/null +++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d29c38a22b6c2b99e8a9f70799738633ff3d65df6a4036194d0382300746bbde +size 15237853312 diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..8e88706 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9b98722c3b22fd03c053bfea987fe72c7af93a0d03a3407c992290593962e3e +size 4536697