39 lines
1.1 KiB
Markdown
39 lines
1.1 KiB
Markdown
---
|
|
base_model: Qwen/Qwen2.5-Coder-3B-Instruct
|
|
license: apache-2.0
|
|
language:
|
|
- en
|
|
- fr
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- decensored
|
|
- heretic
|
|
- uncensored
|
|
- conversational
|
|
- coder
|
|
- qwen
|
|
- 3B
|
|
---
|
|
|
|
# HERETICODER-2.5-3B-IT
|
|
## Model Description
|
|
This is an abliterated decensored version of [Qwen2.5-Coder-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct) using Heretic!
|
|
- **License:** apache-2.0
|
|
- **Abliterated by :** Cannae-AI
|
|
- **Base model :** Qwen/Qwen2.5-Coder-3B-Instruct
|
|
|
|
| Model |Refusals | KL divergence |
|
|
| ----------------------------- | ------ | ------------------ |
|
|
| **HERETICODER-2.5-3B-IT** |**0/100**| **0.30** |
|
|
| **HERETICODER-2.5-7B-IT** |**1/100**| **0.00** |
|
|
|
|
* Parameters:
|
|
* direction_index = 27.30
|
|
* attn.o_proj.max_weight = 1.44
|
|
* attn.o_proj.max_weight_position = 33.01
|
|
* attn.o_proj.min_weight = 1.00
|
|
* attn.o_proj.min_weight_distance = 14.98
|
|
* mlp.down_proj.max_weight = 1.15
|
|
* mlp.down_proj.max_weight_position = 28.50
|
|
* mlp.down_proj.min_weight = 0.95
|
|
* mlp.down_proj.min_weight_distance = 16.30 |