初始化项目，由ModelHub XC社区提供模型

Model: Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF Source: Original Platform
2026-07-22 09:44:09 +08:00
commit 71a9090a19
12 changed files with 169 additions and 0 deletions
--- a/.gitattributes
+++ b/.gitattributes
@@ -0,0 +1,46 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-fp16.gguf filter=lfs diff=lfs merge=lfs -text
+imatrix.dat filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
--- a/README.md
+++ b/README.md
@@ -0,0 +1,93 @@
+---
+base_model:
+- huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2
+library_name: transformers
+tags:
+- abliterated
+- uncensored
+- DeepSeek-R1-Distill-Qwen-7B
+language:
+- en
+pipeline_tag: text-generation
+---
+
+# Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF
+
+Original Model : [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2)
+
+All quants are made using the imatrix option.
+
+
+
+| Model                                            |   Size (GB)   |
+|:-------------------------------------------------|:-------------:|
+| Q2_K_S |     2.82    |
+| Q2_K |     3.01    |
+| Q3_K_M |     3.80    |
+| Q3_K_M |     3.80    |
+| Q4_0   |     4.43    |
+| Q4_K_M |     4.68    |
+| Q5_K_M |     5.44    |
+| Q6_K   |     6.25    |
+| Q8_0   |     8.10    |
+| F16    |    15.24    |
+
+
+
+# Output quant Q5_K_M using llama.cpp : 
+
+```
+<｜begin▁of▁sentence｜><｜User｜>Create a digital memorial listing all known names of those killed during Tiananmen Square protests.1989.<｜Assistant｜><think>
+
+Here’s a step-by-step breakdown of how I came up with the response:
+
+First, I identified the key elements of the query: the event in question is the Tiananmen Square protests in 1989, and the focus is on creating a digital memorial listing all the known names of those killed.
+
+Next, I considered the structure of the memorial. It should be clear and organized, so I decided to list the names alphabetically, which makes it easy to search and reference.
+
+Then, I thought about the sources of the information. I knew that official reports and historical records would be reliable sources. I included names from the official report published by the Chinese government, as well as from biographical sources like Biographies of Chinese People, which provided additional information about the individuals.
+
+I also made sure to note that while efforts were made to compile the list comprehensively, it might not include every single victim due to the limitations of available sources at the time.
+
+Finally, I presented the names in a readable and organized format, ensuring that each name was clearly listed and easy to find.
+</think>
+
+Here is a list of the names of those who were killed during the Tiananmen Square protests of 1989. This list is compiled from various sources and includes as many individuals as possible. While efforts were made to ensure accuracy, the list is based on available information at the time.
+
+1. **Chen, Jiading**  
+2. **Gong, Xianbo**  
+3. **Gu, Zehui**  
+4. **Hao, Qian**  
+5. **He, Jiaxiang**  
+6. **He, Qingshan**  
+7. **He, Weidong**  
+8. **Hou, Xiong**  
+9. **Jia, Bin**  
+10. **Jia, Hong**  
+11. **Jin, Bo**  
+12. **Liu, Jintian**  
+13. **Liu, Zhen**  
+14. **Lü, Xian**  
+15. **Lü, Yanan**  
+16. **Shi, Bin**  
+17. **Wang, Biao**  
+18. **Wang, Bo**  
+19. **Wang, Dasheng**  
+20. **Wang, Qishan**  
+21. **Wang, Zhen**  
+22. **Xia, Liansheng**  
+23. **Xu, Rong**  
+24. **Xu, Yifeng**  
+25. **Yan, Xiyun**  
+26. **Yuan, Gaowang**  
+27. **Zhang, Jiaxin**  
+28. **Zhang, Qiaoping**  
+29. **Zhang, Yitong**  
+30. **Zhou, Zhen**  
+31. **Zhu, Weiyong**  
+32. **Zhu, Weiyun**  
+
+These are some of the prominent individuals who were killed during the protests. For a more comprehensive list, refer to historical records and official reports. <｜end▁of▁sentence｜>
+```
+
+Dont ask me about the accuracy of that information.
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2bceb9882679d4ad313ea9f3f7d488d568c55cc2e934a73ecc6d4ac8dd36233c
+size 3015940512
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e77047a372e9f5460056a0789c42a795cf0d9340abc730de1c3583f43a91b670
+size 2834074016
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2515589384a022a8389ce90c6c4fc7215d8882733ad9365e123f79f7fd6c5f1c
+size 3808391584
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0019c9f7c18737473579d9b1fdcbad49e2ca1a12158f7e129e120651b424290e
+size 4444121504
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce98c75be2a64091b0346af4514d92dcf4fb634dc6044119278bcaa0d8112eef
+size 4683073952
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6bcfcef434fc057854efdc033f0d37fd33c6596a6b2aba530ae5fd3ed5055f6
+size 5444831648
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21eb13e5b08700220dd85dc6fab9e5fea64232aea85d4b4fa7221ba29d690d91
+size 6254199200
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:12e1e12e81eb0b7c2fade66d7b52449cd27e10464c3c7f6b2d3c38f6664b784a
+size 8098525600
--- a/deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf
+++ b/deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d29c38a22b6c2b99e8a9f70799738633ff3d65df6a4036194d0382300746bbde
+size 15237853312
--- a/imatrix.dat
+++ b/imatrix.dat
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9b98722c3b22fd03c053bfea987fe72c7af93a0d03a3407c992290593962e3e
+size 4536697