初始化项目,由ModelHub XC社区提供模型
Model: arzaan789/phi-4-mini-uncensored Source: Original Platform
This commit is contained in:
46
.gitattributes
vendored
Normal file
46
.gitattributes
vendored
Normal file
@@ -0,0 +1,46 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
phi_4_mini_uncensored.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
52
README.md
Normal file
52
README.md
Normal file
@@ -0,0 +1,52 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
base_model: microsoft/Phi-4-mini-instruct
|
||||||
|
tags:
|
||||||
|
- uncensored
|
||||||
|
- abliterated
|
||||||
|
- gguf
|
||||||
|
- phi
|
||||||
|
- conversational
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
---
|
||||||
|
|
||||||
|
# phi-4-mini-uncensored
|
||||||
|
|
||||||
|
Uncensored variant of [microsoft/Phi-4-mini-instruct](https://huggingface.co/microsoft/Phi-4-mini-instruct).
|
||||||
|
|
||||||
|
## Method
|
||||||
|
|
||||||
|
1. **Abliteration** (strength=0.2) — refusal direction removed from all layers
|
||||||
|
2. **LoRA fine-tune** on `Guilherme34/uncensor` (2 epochs, r=16, alpha=32)
|
||||||
|
3. **Re-abliteration** (strength=0.35) — stronger pass to remove residual refusals
|
||||||
|
|
||||||
|
## Eval Results
|
||||||
|
|
||||||
|
| Split | Refused |
|
||||||
|
|-------|---------|
|
||||||
|
| Harmful (64 prompts) | 0/64 |
|
||||||
|
| Harmless (64 prompts) | 0/64 |
|
||||||
|
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
```bash
|
||||||
|
llama-cli -m phi_4_mini_uncensored.Q4_K_M.gguf -p "Your prompt here"
|
||||||
|
```
|
||||||
|
|
||||||
|
## Training Config
|
||||||
|
|
||||||
|
| Parameter | Value |
|
||||||
|
|-----------|-------|
|
||||||
|
| Base Model | microsoft/Phi-4-mini-instruct |
|
||||||
|
| Fine-tune Dataset | Guilherme34/uncensor |
|
||||||
|
| Epochs | 2 |
|
||||||
|
| LoRA r | 16 |
|
||||||
|
| LoRA alpha | 32 |
|
||||||
|
| Learning Rate | 0.0002 |
|
||||||
|
| Abliteration Strength | 0.2 |
|
||||||
|
| Re-abliteration Strength | 0.35 |
|
||||||
|
|
||||||
|
## Credits
|
||||||
|
|
||||||
|
- Abliteration technique: [andyrdt/refusal_direction](https://github.com/andyrdt/refusal_direction)
|
||||||
|
- Weight editing: [Sumandora/remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers)
|
||||||
3
phi_4_mini_uncensored.Q2_K.gguf
Normal file
3
phi_4_mini_uncensored.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f74157f12fe7c2023e5bee23aed28059fdfd68dccd2d6524e5622ee416d21688
|
||||||
|
size 1733753056
|
||||||
3
phi_4_mini_uncensored.Q3_K_L.gguf
Normal file
3
phi_4_mini_uncensored.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4f2fd45283047956bcf8220cda26056ae27b6a59548bcf1fa61140a195134394
|
||||||
|
size 2312567008
|
||||||
3
phi_4_mini_uncensored.Q3_K_M.gguf
Normal file
3
phi_4_mini_uncensored.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:140709531a47d3e912e6c90b52372be3b8a78c17eb5ccc80fd256ec214bc05e5
|
||||||
|
size 2121464032
|
||||||
3
phi_4_mini_uncensored.Q3_K_S.gguf
Normal file
3
phi_4_mini_uncensored.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:96f8b5c6a44284263794bfb05706aaf89dd71f4b73fd7a03754881f03b38cb70
|
||||||
|
size 1897330912
|
||||||
3
phi_4_mini_uncensored.Q4_K_M.gguf
Normal file
3
phi_4_mini_uncensored.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8b31096b6bd4b699aa68adbafb3d0a3a339c354ad87274ed97ab2d465b0d6ce3
|
||||||
|
size 2493839584
|
||||||
3
phi_4_mini_uncensored.Q4_K_S.gguf
Normal file
3
phi_4_mini_uncensored.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8d28190894e4721830574b4f682fba9e8728b067abb95eaea03223d58662062c
|
||||||
|
size 2345597152
|
||||||
3
phi_4_mini_uncensored.Q5_K_M.gguf
Normal file
3
phi_4_mini_uncensored.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0d3b46784d7e795aa1697e403833233c0965af5b1e6e40ab738565237fe70139
|
||||||
|
size 2814703840
|
||||||
3
phi_4_mini_uncensored.Q5_K_S.gguf
Normal file
3
phi_4_mini_uncensored.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0ae25166879b3066bdb833aca760624222fdb490e309f6b0304e5d77d93b6857
|
||||||
|
size 2727803104
|
||||||
3
phi_4_mini_uncensored.Q6_K.gguf
Normal file
3
phi_4_mini_uncensored.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4bad17532ef3176068cb1682e6a75d5042b68aff0f7c3cd38cbe12e5a258f172
|
||||||
|
size 3155622112
|
||||||
3
phi_4_mini_uncensored.Q8_0.gguf
Normal file
3
phi_4_mini_uncensored.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:daedf5c8b9c4f1dcb14e6a108c38587ca52351b489e77e0e75be8d06c8369b3f
|
||||||
|
size 4084610272
|
||||||
3
phi_4_mini_uncensored.f16.gguf
Normal file
3
phi_4_mini_uncensored.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bfb8c5d377ac4af785ba99fed03832584547ba03c8915136c71d69d7518300df
|
||||||
|
size 7680693472
|
||||||
Reference in New Issue
Block a user