prithivMLmods/Qwen3-4B-abliterated-f32-GGUFs
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: prithivMLmods/Qwen3-4B-abliterated-f32-GGUFs
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-31 00:20:17 +08:00
commit e7a6d0e50f
16 changed files with 132 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.BF16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.F16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.F32.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-abliterated.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3-4B-abliterated.BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39cc7e12e51756eb8b57c5280fe4cb167258417c6de5eb8d6be20e510812e09b
size 8051284640

3
Qwen3-4B-abliterated.F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2815efee1286e6a436cb653a20a56b7850808e21703d5ebd2e65f5e3f2b977c
size 8051284640

3
Qwen3-4B-abliterated.F32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a0b4b574a1754db04bea1b457f8b97ea9ede0c5b5d80651e15746395c2b188ae
size 16095828640

3
Qwen3-4B-abliterated.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72ecf7e26b309447168edf2f200d78c4df60f19393f76908a1d58a6f0832c4f3
size 1669499040

3
Qwen3-4B-abliterated.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffe29478580416bc6c67234a19dc3790cb3e21e7fa8494125ec04cb44bd28224
size 2239785120

3
Qwen3-4B-abliterated.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3bfd85c59653d3ab8c8a31b562a5c9124e27ead773d9029b962208d41b4f1d25
size 2075617440

3
Qwen3-4B-abliterated.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20046cbb04351c796529dbf65ceb7b72d93874cd837ebf7f96b579c880306a7b
size 1886996640

3
Qwen3-4B-abliterated.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:908d5850bd5e288dd6bd5ba105a5e3d34d00563ac7ebd7d0fb3771907929e21c
size 2497280160

3
Qwen3-4B-abliterated.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5349e4a326c7d1ec5e4554848a3bc9d8708ddd9716d0049bb6c4a4d8c567a853
size 2383308960

3
Qwen3-4B-abliterated.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71f219496895a369d2840426d43c7d9880673745ba4dad849e459d9a213ffd1c
size 2889513120

3
Qwen3-4B-abliterated.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b5bfa82dc03b56729fb5fada2b819e3654556ea451fa8f9b0ba0e9d42340072
size 2823710880

3
Qwen3-4B-abliterated.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f38e9579bde4c8821d2da0581d6af8b60c5ec4a3256e58ad995f8c3a10de712
size 3306260640

3
Qwen3-4B-abliterated.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10905f155df20acce013ed54776292cb9b7c2c3f7c24e2682a94188919ffbe34
size 4280404640

42
README.md Normal file
View File

@@ -0,0 +1,42 @@
---
license: apache-2.0
language:
- en
base_model:
- Qwen/Qwen3-4B
pipeline_tag: text-generation
library_name: transformers
tags:
- text-generation-inference
---
# **Qwen3-4B-abliterated-f32-GGUFs**
> Qwen3-4B-abliterated is an experimental, uncensored version of the Qwen/Qwen3-4B language model that explores how refusals and latent fine-tuning work in large language models using a novel "abliteration" technique, which subtracts a computed refusal direction from hidden module states (such as o_proj) to minimize refusals without degrading output quality. The process involves comparing residual streams between harmful and harmless prompts, orthogonalizing hidden states with weight factors distributed across layers, and iterative or accumulated orthogonalization methods for efficiency.
## Model Files
| File name | Size | Quant Type |
|-----------|------|------------|
| Qwen3-4B-abliterated.F32.gguf | 16.1 GB | F32 |
| Qwen3-4B-abliterated.BF16.gguf | 8.05 GB | BF16 |
| Qwen3-4B-abliterated.F16.gguf | 8.05 GB | F16 |
| Qwen3-4B-abliterated.Q8_0.gguf | 4.28 GB | Q8_0 |
| Qwen3-4B-abliterated.Q6_K.gguf | 3.31 GB | Q6_K |
| Qwen3-4B-abliterated.Q5_K_M.gguf | 2.89 GB | Q5_K_M |
| Qwen3-4B-abliterated.Q5_K_S.gguf | 2.82 GB | Q5_K_S |
| Qwen3-4B-abliterated.Q4_K_M.gguf | 2.5 GB | Q4_K_M |
| Qwen3-4B-abliterated.Q4_K_S.gguf | 2.38 GB | Q4_K_S |
| Qwen3-4B-abliterated.Q3_K_L.gguf | 2.24 GB | Q3_K_L |
| Qwen3-4B-abliterated.Q3_K_M.gguf | 2.08 GB | Q3_K_M |
| Qwen3-4B-abliterated.Q3_K_S.gguf | 1.89 GB | Q3_K_S |
| Qwen3-4B-abliterated.Q2_K.gguf | 1.67 GB | Q2_K |
## Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)

3
config.json Normal file
View File

@@ -0,0 +1,3 @@
{
"model_type": "qwen3"
}