初始化项目,由ModelHub XC社区提供模型
Model: noctrex/Llama-3.3-8B-Instruct-128k-abliterated-GGUF Source: Original Platform
This commit is contained in:
45
.gitattributes
vendored
Normal file
45
.gitattributes
vendored
Normal file
@@ -0,0 +1,45 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Llama-3.3-8B-Instruct-128k-abliterated-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-BF16.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-BF16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:af9db43c512d838aac4a042719c47fd23ccc81d0013be93aaa9eb063fb79252e
|
||||||
|
size 16068895936
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-F16.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a59f38eb3ad590107ad15cc8dda267a0a85bfd37a5c10b2c52b35565c3520606
|
||||||
|
size 16068895936
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-IQ3_M.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:afe592bf80d68bc52342ad818afbfd28cc09ce715784c9aa0c2733679865adfa
|
||||||
|
size 3784828288
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-IQ4_NL.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a1ab85506bd50a4962738491e03c198972b8b2aeefe7e1e3a59c6420675a86ed
|
||||||
|
size 4677993856
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-IQ4_XS.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:658bde3c63ad30b131a60b9a34d173c7f5bd870ec8c87c9c8bf0770c429acaa7
|
||||||
|
size 4447667584
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-Q4_K_M.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8bd94b8c234050a91068b7a333422dc89da25b798fa38a828c32f8393ccf4f37
|
||||||
|
size 4920739200
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-Q5_K_M.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:19f248c133abc63afad577e4f0e194e2598c3dba61a4eea9c81295892a2d0912
|
||||||
|
size 5732992384
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-Q6_K.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f4eff36baf4473516a318b2968b1717311087ed0ffc04ce8d8f8eba8d8763cd0
|
||||||
|
size 6596011392
|
||||||
3
Llama-3.3-8B-Instruct-128k-abliterated-Q8_0.gguf
Normal file
3
Llama-3.3-8B-Instruct-128k-abliterated-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:cdb5b4ab79891a83f80c66afd48cab9951edf259d7b922d4365a9295f95dab67
|
||||||
|
size 8540775808
|
||||||
33
README.md
Normal file
33
README.md
Normal file
@@ -0,0 +1,33 @@
|
|||||||
|
---
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
tags:
|
||||||
|
- uncensored
|
||||||
|
- abliterated
|
||||||
|
base_model:
|
||||||
|
- allura-forge/Llama-3.3-8B-Instruct
|
||||||
|
---
|
||||||
|
This is an abliterated version of [Llama-3.3-8B-Instruct](https://huggingface.co/allura-forge/Llama-3.3-8B-Instruct), made using [Heretic v1.1.0](https://github.com/p-e-w/heretic)
|
||||||
|
|
||||||
|
This is the model with [128k context](https://huggingface.co/shb777/Llama-3.3-8B-Instruct).
|
||||||
|
|
||||||
|
The quantizations were created using an imatrix merged from [combined\_en\_medium](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/combined_en_medium.parquet) and [harmful.txt](https://github.com/Sumandora/remove-refusals-with-transformers) to leverage the abliterated nature of the model.
|
||||||
|
|
||||||
|
## Performance
|
||||||
|
|
||||||
|
| Metric | This model | Original model |
|
||||||
|
| :----- | :--------: | :---------------------------: |
|
||||||
|
| **Refusals** | 5/100 | 95/100 |
|
||||||
|
| KL divergence | 0.0919 | 0 |
|
||||||
|
|
||||||
|
|
||||||
|
## BibTeX entry and citation info
|
||||||
|
```bibtex
|
||||||
|
@misc{heretic,
|
||||||
|
author = {Weidmann, Philipp Emanuel},
|
||||||
|
title = {Heretic: Fully automatic censorship removal for language models},
|
||||||
|
year = {2025},
|
||||||
|
publisher = {GitHub},
|
||||||
|
journal = {GitHub repository},
|
||||||
|
howpublished = {\url{https://github.com/p-e-w/heretic}}
|
||||||
|
}
|
||||||
|
```
|
||||||
3
imatrix.gguf
Normal file
3
imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0364c1ff6d404ad598d92f260185deaaef5e0bd5686bae14b7afbe15507165ff
|
||||||
|
size 5015232
|
||||||
Reference in New Issue
Block a user