Model: Sabomako/gemma-3-12b-it-heretic Source: Original Platform
base_model, pipeline_tag, tags
| base_model | pipeline_tag | tags | |||||
|---|---|---|---|---|---|---|---|
|
image-text-to-text |
|
This is a decensored version of google/gemma-3-12b-it, made using Heretic v1.2.0 with (MPOA) Magnitude-Preserving Orthogonal Ablation
Abliteration parameters
| Parameter | Value |
|---|---|
| direction_index | 20.58 |
| attn.o_proj.max_weight | 1.29 |
| attn.o_proj.max_weight_position | 28.86 |
| attn.o_proj.min_weight | 0.98 |
| attn.o_proj.min_weight_distance | 23.38 |
| mlp.down_proj.max_weight | 1.36 |
| mlp.down_proj.max_weight_position | 29.82 |
| mlp.down_proj.min_weight | 0.77 |
| mlp.down_proj.min_weight_distance | 25.21 |
Performance
| Metric | This model | Original model (google/gemma-3-12b-it) |
|---|---|---|
| KL divergence | 0.024 | 0 (by definition) |
| Refusals | 4/100 | 97/100 |
Description
Languages
Jinja
100%