Heretic-Dolphin3.0-Qwen2.5-3b/README.md

base_model, tags, pipeline_tag

base_model	tags	pipeline_tag
dphn/Dolphin3.0-Qwen2.5-3b	heretic	text-generation

<style> *::selection {background: transparent !important; color: inherit !important;} p,a,summary,details{color:#cccccc;} details p{max-width: 92%;} </style>

▀█▀ █▄ ▄█ █ █ █▀▀ █▀▄ █▀▀ ▀█▀ ▀█▀ █▀▀ █ █ ▀ █ █▀█ █▀▀ █▀▄ █▀▀ █ █ █ ▀▀▀ ▀ ▀ ▀ ▀ ▀▀▀ ▀ ▀ ▀▀▀ ▀ ▀▀▀ ▀▀▀

Abliterated/Heretic dphn/Dolphin3.0-Qwen2.5-3b

Check Quants

Refusals (this model): 4/100
Original (dphn/Dolphin3.0-Qwen2.5-3b): 47/100
KL divergence: 0.0804

Parameters

direction_index = per layer
attn.o_proj.max_weight = 0.88
attn.o_proj.max_weight_position = 21.47
attn.o_proj.min_weight = 0.55
attn.o_proj.min_weight_distance = 1.60
mlp.down_proj.max_weight = 1.01
mlp.down_proj.max_weight_position = 22.57
mlp.down_proj.min_weight = 0.68
mlp.down_proj.min_weight_distance = 17.22