初始化项目,由ModelHub XC社区提供模型
Model: Sabomako/gemma-3-12b-it-heretic Source: Original Platform
This commit is contained in:
34
README.md
Normal file
34
README.md
Normal file
@@ -0,0 +1,34 @@
|
||||
---
|
||||
base_model:
|
||||
- google/gemma-3-12b-it
|
||||
pipeline_tag: image-text-to-text
|
||||
tags:
|
||||
- heretic
|
||||
- uncensored
|
||||
- decensored
|
||||
- abliterated
|
||||
---
|
||||
# This is a decensored version of [google/gemma-3-12b-it](https://huggingface.co/google/gemma-3-12b-it), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0 with (MPOA) Magnitude-Preserving Orthogonal Ablation
|
||||
|
||||
## Abliteration parameters
|
||||
|
||||
| Parameter | Value |
|
||||
| :-------- | :---: |
|
||||
| **direction_index** | 20.58 |
|
||||
| **attn.o_proj.max_weight** | 1.29 |
|
||||
| **attn.o_proj.max_weight_position** | 28.86 |
|
||||
| **attn.o_proj.min_weight** | 0.98 |
|
||||
| **attn.o_proj.min_weight_distance** | 23.38 |
|
||||
| **mlp.down_proj.max_weight** | 1.36 |
|
||||
| **mlp.down_proj.max_weight_position** | 29.82 |
|
||||
| **mlp.down_proj.min_weight** | 0.77 |
|
||||
| **mlp.down_proj.min_weight_distance** | 25.21 |
|
||||
|
||||
## Performance
|
||||
|
||||
| Metric | This model | Original model ([google/gemma-3-12b-it](https://huggingface.co/google/gemma-3-12b-it)) |
|
||||
| :----- | :--------: | :---------------------------: |
|
||||
| **KL divergence** | 0.024 | 0 *(by definition)* |
|
||||
| **Refusals** | 4/100 | 97/100 |
|
||||
|
||||
-----
|
||||
Reference in New Issue
Block a user