初始化项目，由ModelHub XC社区提供模型

Model: mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,60 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+deepseek-llm-7b-chat-abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,91 @@
+---
+base_model: richardyoung/deepseek-llm-7b-chat-abliterated
+language:
+- en
+library_name: transformers
+license: other
+mradermacher:
+  readme_rev: 1
+quantized_by: mradermacher
+tags:
+- abliteration
+- uncensored
+- heretic
+- representation-engineering
+- refusal-removal
+---
+## About
+
+<!-- ### quantize_version: 2 -->
+<!-- ### output_tensor_quantised: 1 -->
+<!-- ### convert_type: hf -->
+<!-- ### vocab_type:  -->
+<!-- ### tags: nicoboss -->
+<!-- ### quants:  Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
+<!-- ### quants_skip:  -->
+<!-- ### skip_mmproj:  -->
+weighted/imatrix quants of https://huggingface.co/richardyoung/deepseek-llm-7b-chat-abliterated
+
+<!-- provided-files -->
+
+***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#deepseek-llm-7b-chat-abliterated-i1-GGUF).***
+
+static quants are available at https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-GGUF
+## Usage
+
+If you are unsure how to use GGUF files, refer to one of [TheBloke's
+READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
+more details, including on how to concatenate multi-part files.
+
+## Provided Quants
+
+(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
+
+| Link | Type | Size/GB | Notes |
+|:-----|:-----|--------:|:------|
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 1.8 | for the desperate |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 2.5 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.6 | very low quality |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 3.2 | beats Q3_K* |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.2 | IQ3_XS probably better |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 3.4 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.8 | IQ3_M probably better |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.1 | prefer IQ4_XS |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 4.1 | fast, low quality |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.1 | optimal size/speed/quality |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.3 | fast, recommended |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q4_1.gguf) | i1-Q4_1 | 4.5 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.0 |  |
+| [GGUF](https://huggingface.co/mradermacher/deepseek-llm-7b-chat-abliterated-i1-GGUF/resolve/main/deepseek-llm-7b-chat-abliterated.i1-Q6_K.gguf) | i1-Q6_K | 5.8 | practically like static Q6_K |
+
+Here is a handy graph by ikawrakow comparing some lower-quality quant
+types (lower is better):
+
+![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
+
+And here are Artefact2's thoughts on the matter:
+https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
+
+## FAQ / Model Request
+
+See https://huggingface.co/mradermacher/model_requests for some answers to
+questions you might have and/or if you want some other model quantized.
+
+## Thanks
+
+I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
+me use its servers and providing upgrades to my workstation to enable
+this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
+
+<!-- end -->

deepseek-llm-7b-chat-abliterated.i1-IQ1_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec99b33515c9475f8971fc54cb87945fb254782c9dad769bcaa99b6e886b0643
+size 1848564416

deepseek-llm-7b-chat-abliterated.i1-IQ1_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c0ecfa8785c231bf5b9ea8ba86e5f17dcd7a4a588f2b07252dfdc69eb3f5d27
+size 1733032640

deepseek-llm-7b-chat-abliterated.i1-IQ2_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99febd1bb91d67be82ba4bbf17188e802ea2e4360cbc4f4138dfcf5f1b557863
+size 2543164096

deepseek-llm-7b-chat-abliterated.i1-IQ2_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef6a272b58dffa5134ca48b231b3c9704e9f8c23ca6f5334007a3da9336b27d9
+size 2389121728

deepseek-llm-7b-chat-abliterated.i1-IQ2_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a234f26e284f007fe632aadfd46678c8e160183a34d4605b23035ca57881ed3a
+size 2210888384

deepseek-llm-7b-chat-abliterated.i1-IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:56c7a7754b099359ee465d2fdd7ae26b98e4ca5fde5a5fae13f2973bdfcb4c97
+size 2041117376

deepseek-llm-7b-chat-abliterated.i1-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1442be9ab10313f196a94277eb0a0bab73832aa4a8ef4d9425e2cfee9ebcc6e0
+size 3289676480

deepseek-llm-7b-chat-abliterated.i1-IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fcf00ca4ac78ed755ea6d73145927f40bc6456b0c260486955783585568ea4d5
+size 3138017984

deepseek-llm-7b-chat-abliterated.i1-IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ebf15ddd0435ae6ea5f4e4a3df9498558fba435e6538ee0551518fd4af760e9
+size 2993609408

deepseek-llm-7b-chat-abliterated.i1-IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5ccf7cbf0e1962bccf4b8796f7db37b2b66e0bb49a774d7f0d265a39c20aab39
+size 2758400704

deepseek-llm-7b-chat-abliterated.i1-IQ4_NL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f98da1ab06020b2b4d4cca5b47e0ec3e689490c63acb41dffbbebf0749e640e8
+size 4000062144

deepseek-llm-7b-chat-abliterated.i1-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c5436920a5fba72072d97f92b00e04000bdf02dc18ed2f9d9005d414f5170de
+size 3797228224

deepseek-llm-7b-chat-abliterated.i1-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6dd06e0f4d8b1d86eb36bb9d72cd27edd065d3a897d28aa5c7acbf0593ee5610
+size 2718423744

deepseek-llm-7b-chat-abliterated.i1-Q2_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e5144437920028b54215bc0289ff8abeba82985ee4a0a8a41fb472d2517bc12
+size 2510510784

deepseek-llm-7b-chat-abliterated.i1-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7fcab1ff5e6a1f4030f1a103e1b1fc721299523d19ff18aec9fcca7e06d081b
+size 3746273984

deepseek-llm-7b-chat-abliterated.i1-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e7e52115cfe3a1b7ffeef094d9ba88505591c590ee190a2a33afca377e1baea8
+size 3461192384

deepseek-llm-7b-chat-abliterated.i1-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe984d2218a77b6e0b07074c551091ad93b3f1f5de170e50425dd1b4a3008788
+size 3138017984

deepseek-llm-7b-chat-abliterated.i1-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:673eee59de31e621a1a4c8377d8ded159f6d7793c154dad26b4865af5b319c1d
+size 4008516288

deepseek-llm-7b-chat-abliterated.i1-Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b0d6aeb5b3fd76fb1ece749534691d1cc1e0a4dbdb7b09bdedb0934cf58a7c1
+size 4405729984

deepseek-llm-7b-chat-abliterated.i1-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9c7161494ae54bb951f2e71ce6513db3a60a87b44f2a7b05c0c203e16ba65cf
+size 4223359680

deepseek-llm-7b-chat-abliterated.i1-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b0ff06272df69c286dbf61c03dd5a868aec4a2165f9a11ddce3d5a16873a271
+size 4025359040

deepseek-llm-7b-chat-abliterated.i1-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ed72b6c7a33617d6ac102202699ca056f0f83bd21197d01e3f977b9bb16441e
+size 4926429888

deepseek-llm-7b-chat-abliterated.i1-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ddba770d50d87bdee2c37ce525a67954b090ea5ed2492c11fabe121c1b03678b
+size 4811397824

deepseek-llm-7b-chat-abliterated.i1-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:48e92fa4b8dd0dd67b9ae125b7b60e55f40e56f4f2cb25a972d68f3d70168966
+size 5673441984

deepseek-llm-7b-chat-abliterated.imatrix.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dffb7311897bae52a3837f980d49f70893fb2dcebce94bee7bb25a2883219152
+size 4302400