noctrex/Mistral-7B-Instruct-v0.3-abliterated-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: noctrex/Mistral-7B-Instruct-v0.3-abliterated-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-31 12:44:17 +08:00
commit 4f23bd5dfd
15 changed files with 117 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

45
.gitattributes vendored Normal file
View File

@@ -0,0 +1,45 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-BF16.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.3-abliterated-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

3
Mistral-7B-Instruct-v0.3-abliterated-BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0919df32916526d4f54e71d5c1e87448948d798de6667045dd747bb49eb0616c
size 14497341152

3
Mistral-7B-Instruct-v0.3-abliterated-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7659a6861832dba08a3dccf3a26900cad86952e85c567714010e2d315e5137db
size 3288850336

3
Mistral-7B-Instruct-v0.3-abliterated-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e941323f59e73ccb3b0b0ba7778a98cc17be9d8e51e8228dd53091a9dfa3eb6b
size 4130070432

3
Mistral-7B-Instruct-v0.3-abliterated-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e52809a7df1df16ca5c3bf4b9f6d58cc2a2b2b26d7b0fbed62c1f9f2533509a3
size 3911966624

3
Mistral-7B-Instruct-v0.3-abliterated-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5df54856ce5166016688063dd08291ab5c907237b1de65d194dfcd9c55bc6b8
size 3522944928

3
Mistral-7B-Instruct-v0.3-abliterated-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71cc35de252f469bc28c9c216e1641a0be8b9a61da3f196a105f7c93091e787d
size 4372815776

3
Mistral-7B-Instruct-v0.3-abliterated-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:289cfce33687c5b2bc7a9afe25d7e8ad4c3f3b322071e163cb813bb6d119126f
size 5136179104

3
Mistral-7B-Instruct-v0.3-abliterated-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:501811d5cdde3bfe3650f032f61527d65ea27b2bc491a5f8ebfa4ffe896c54b8
size 5947252640

3
Mistral-7B-Instruct-v0.3-abliterated-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9d4bfaba173c25094cfcc3e8d1a4816e144a6ced77764b4604292a62349193a
size 7702568864

42
README.md Normal file
View File

@@ -0,0 +1,42 @@
---
pipeline_tag: text-generation
tags:
- uncensored
- abliterated
base_model:
- mistralai/Mistral-7B-Instruct-v0.3
---
This is a abliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3), made using [Heretic](https://github.com/p-e-w/heretic)
The quantizations were created using an imatrix merged from [text\_en\_large](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/text_en_large.parquet) and [harmful.txt](https://github.com/Sumandora/remove-refusals-with-transformers) to leverage the abliterated nature of the model.
![It's an older model, sir, but it checks out](older-model.jpg)
## Performance
| Metric | This model | [Original model](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) |
| :----- | :--------: | :---------------------------: |
| **KL divergence** | 0.15 | 0 *(by definition)* |
| **Refusals** | 3/100 | 85/100 |
## Analysis against the original model:
- Total Tensors: 291
- Tensors with Diffs: 47 (16.2%)
- Average % Diff: 6.99%
- Median % Diff: 0.00%
- Min/Max % Diff: 0.00% / 46.77%
- Std Dev % Diff: 15.97%
- Skewness % Diff: 1.86
- Avg L2 Norm: 144619.57
- Tensors with >5% diff: 47
- Top differences:
- blk.14.attn_output.weight ((4096, 8192), L2: 669167.94): 46.77%
- blk.13.attn_output.weight ((4096, 8192), L2: 667456.52): 46.51%
- blk.16.attn_output.weight ((4096, 8192), L2: 667644.60): 46.46%
- blk.12.attn_output.weight ((4096, 8192), L2: 664339.15): 46.03%
- blk.15.attn_output.weight ((4096, 8192), L2: 664117.46): 45.94%
![Tensor Difference Distribution](tensor_difference_distribution.png)
![Tensor Charts](tensor_charts.png)

3
imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a44d7dcd0c9f905bdc017ed8f2ed9477fca53874497f3e0717f306d27d9b74f0
size 5015232

BIN
older-model.jpg Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 38 KiB

BIN
tensor_charts.png Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 70 KiB

BIN
tensor_difference_distribution.png Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 35 KiB