初始化项目,由ModelHub XC社区提供模型
Model: Cannae-AI/HERETICODER-2.5-3B-IT Source: Original Platform
This commit is contained in:
39
README.md
Normal file
39
README.md
Normal file
@@ -0,0 +1,39 @@
|
||||
---
|
||||
base_model: Qwen/Qwen2.5-Coder-3B-Instruct
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
- fr
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- decensored
|
||||
- heretic
|
||||
- uncensored
|
||||
- conversational
|
||||
- coder
|
||||
- qwen
|
||||
- 3B
|
||||
---
|
||||
|
||||
# HERETICODER-2.5-3B-IT
|
||||
## Model Description
|
||||
This is an abliterated decensored version of [Qwen2.5-Coder-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct) using Heretic!
|
||||
- **License:** apache-2.0
|
||||
- **Abliterated by :** Cannae-AI
|
||||
- **Base model :** Qwen/Qwen2.5-Coder-3B-Instruct
|
||||
|
||||
| Model |Refusals | KL divergence |
|
||||
| ----------------------------- | ------ | ------------------ |
|
||||
| **HERETICODER-2.5-3B-IT** |**0/100**| **0.30** |
|
||||
| **HERETICODER-2.5-7B-IT** |**1/100**| **0.00** |
|
||||
|
||||
* Parameters:
|
||||
* direction_index = 27.30
|
||||
* attn.o_proj.max_weight = 1.44
|
||||
* attn.o_proj.max_weight_position = 33.01
|
||||
* attn.o_proj.min_weight = 1.00
|
||||
* attn.o_proj.min_weight_distance = 14.98
|
||||
* mlp.down_proj.max_weight = 1.15
|
||||
* mlp.down_proj.max_weight_position = 28.50
|
||||
* mlp.down_proj.min_weight = 0.95
|
||||
* mlp.down_proj.min_weight_distance = 16.30
|
||||
Reference in New Issue
Block a user