commit 4f23bd5dfdaa540345efa9de02ecd22adfd5f5e2 Author: ModelHub XC Date: Fri Jul 31 12:44:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: noctrex/Mistral-7B-Instruct-v0.3-abliterated-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b1eb6ea --- /dev/null +++ b/.gitattributes @@ -0,0 +1,45 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-BF16.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Mistral-7B-Instruct-v0.3-abliterated-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Mistral-7B-Instruct-v0.3-abliterated-BF16.gguf b/Mistral-7B-Instruct-v0.3-abliterated-BF16.gguf new file mode 100644 index 0000000..cd13823 --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-BF16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0919df32916526d4f54e71d5c1e87448948d798de6667045dd747bb49eb0616c +size 14497341152 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-IQ3_M.gguf b/Mistral-7B-Instruct-v0.3-abliterated-IQ3_M.gguf new file mode 100644 index 0000000..8eca560 --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7659a6861832dba08a3dccf3a26900cad86952e85c567714010e2d315e5137db +size 3288850336 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-IQ4_NL.gguf b/Mistral-7B-Instruct-v0.3-abliterated-IQ4_NL.gguf new file mode 100644 index 0000000..000efd7 --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e941323f59e73ccb3b0b0ba7778a98cc17be9d8e51e8228dd53091a9dfa3eb6b +size 4130070432 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-IQ4_XS.gguf b/Mistral-7B-Instruct-v0.3-abliterated-IQ4_XS.gguf new file mode 100644 index 0000000..efe1361 --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e52809a7df1df16ca5c3bf4b9f6d58cc2a2b2b26d7b0fbed62c1f9f2533509a3 +size 3911966624 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-Q3_K_M.gguf b/Mistral-7B-Instruct-v0.3-abliterated-Q3_K_M.gguf new file mode 100644 index 0000000..090ddc9 --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c5df54856ce5166016688063dd08291ab5c907237b1de65d194dfcd9c55bc6b8 +size 3522944928 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-Q4_K_M.gguf b/Mistral-7B-Instruct-v0.3-abliterated-Q4_K_M.gguf new file mode 100644 index 0000000..f0b776e --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71cc35de252f469bc28c9c216e1641a0be8b9a61da3f196a105f7c93091e787d +size 4372815776 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-Q5_K_M.gguf b/Mistral-7B-Instruct-v0.3-abliterated-Q5_K_M.gguf new file mode 100644 index 0000000..4bf7bfe --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:289cfce33687c5b2bc7a9afe25d7e8ad4c3f3b322071e163cb813bb6d119126f +size 5136179104 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-Q6_K.gguf b/Mistral-7B-Instruct-v0.3-abliterated-Q6_K.gguf new file mode 100644 index 0000000..4ce2247 --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:501811d5cdde3bfe3650f032f61527d65ea27b2bc491a5f8ebfa4ffe896c54b8 +size 5947252640 diff --git a/Mistral-7B-Instruct-v0.3-abliterated-Q8_0.gguf b/Mistral-7B-Instruct-v0.3-abliterated-Q8_0.gguf new file mode 100644 index 0000000..916b3b6 --- /dev/null +++ b/Mistral-7B-Instruct-v0.3-abliterated-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9d4bfaba173c25094cfcc3e8d1a4816e144a6ced77764b4604292a62349193a +size 7702568864 diff --git a/README.md b/README.md new file mode 100644 index 0000000..6031f7b --- /dev/null +++ b/README.md @@ -0,0 +1,42 @@ +--- +pipeline_tag: text-generation +tags: +- uncensored +- abliterated +base_model: +- mistralai/Mistral-7B-Instruct-v0.3 +--- +This is a abliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3), made using [Heretic](https://github.com/p-e-w/heretic) + +The quantizations were created using an imatrix merged from [text\_en\_large](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/text_en_large.parquet) and [harmful.txt](https://github.com/Sumandora/remove-refusals-with-transformers) to leverage the abliterated nature of the model. + +![It's an older model, sir, but it checks out](older-model.jpg) + +## Performance + +| Metric | This model | [Original model](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) | +| :----- | :--------: | :---------------------------: | +| **KL divergence** | 0.15 | 0 *(by definition)* | +| **Refusals** | 3/100 | 85/100 | + +## Analysis against the original model: +- Total Tensors: 291 +- Tensors with Diffs: 47 (16.2%) +- Average % Diff: 6.99% +- Median % Diff: 0.00% +- Min/Max % Diff: 0.00% / 46.77% +- Std Dev % Diff: 15.97% +- Skewness % Diff: 1.86 +- Avg L2 Norm: 144619.57 +- Tensors with >5% diff: 47 +- Top differences: + - blk.14.attn_output.weight ((4096, 8192), L2: 669167.94): 46.77% + - blk.13.attn_output.weight ((4096, 8192), L2: 667456.52): 46.51% + - blk.16.attn_output.weight ((4096, 8192), L2: 667644.60): 46.46% + - blk.12.attn_output.weight ((4096, 8192), L2: 664339.15): 46.03% + - blk.15.attn_output.weight ((4096, 8192), L2: 664117.46): 45.94% + +![Tensor Difference Distribution](tensor_difference_distribution.png) + +![Tensor Charts](tensor_charts.png) + diff --git a/imatrix.gguf b/imatrix.gguf new file mode 100644 index 0000000..ef19994 --- /dev/null +++ b/imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a44d7dcd0c9f905bdc017ed8f2ed9477fca53874497f3e0717f306d27d9b74f0 +size 5015232 diff --git a/older-model.jpg b/older-model.jpg new file mode 100644 index 0000000..4e9b88b Binary files /dev/null and b/older-model.jpg differ diff --git a/tensor_charts.png b/tensor_charts.png new file mode 100644 index 0000000..c018118 Binary files /dev/null and b/tensor_charts.png differ diff --git a/tensor_difference_distribution.png b/tensor_difference_distribution.png new file mode 100644 index 0000000..fcf1b82 Binary files /dev/null and b/tensor_difference_distribution.png differ