Model: Cannae-AI/HERETICODER-2.5-3B-IT Source: Original Platform
base_model, license, language, pipeline_tag, tags
| base_model | license | language | pipeline_tag | tags | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen2.5-Coder-3B-Instruct | apache-2.0 |
|
text-generation |
|
HERETICODER-2.5-3B-IT
Model Description
This is an abliterated decensored version of Qwen2.5-Coder-3B-Instruct using Heretic!
- License: apache-2.0
- Abliterated by : Cannae-AI
- Base model : Qwen/Qwen2.5-Coder-3B-Instruct
| Model | Refusals | KL divergence |
|---|---|---|
| HERETICODER-2.5-3B-IT | 0/100 | 0.30 |
| HERETICODER-2.5-7B-IT | 1/100 | 0.00 |
- Parameters:
- direction_index = 27.30
- attn.o_proj.max_weight = 1.44
- attn.o_proj.max_weight_position = 33.01
- attn.o_proj.min_weight = 1.00
- attn.o_proj.min_weight_distance = 14.98
- mlp.down_proj.max_weight = 1.15
- mlp.down_proj.max_weight_position = 28.50
- mlp.down_proj.min_weight = 0.95
- mlp.down_proj.min_weight_distance = 16.30
Description
Languages
Jinja
100%