26 lines
1.6 KiB
Markdown
26 lines
1.6 KiB
Markdown
---
|
|
base_model:
|
|
- dphn/Dolphin3.0-Qwen2.5-3b
|
|
tags:
|
|
- heretic
|
|
pipeline_tag: text-generation
|
|
---
|
|
<div style="background: #000; margin: auto; border: 1px solid #FFFFFF; background-image: url('https://c.tenor.com/r47ZgZUPwEwAAAAC/tenor.gif'); background-size: 30vw 70vh; background-repeat: repeat;">
|
|
<style>
|
|
*::selection {background: transparent !important; color: inherit !important;}
|
|
p,a,summary,details{color:#cccccc;}
|
|
details p{max-width: 92%;}
|
|
</style><center></br></br></br>
|
|
<h2 style="margin: 0; padding: 0; white-space: pre; font-family: monospace; line-height: 1.1; letter-spacing: -0.5px; font-size: 25px; color:#cccccc;">▀█▀ █▄ ▄█ █ █ █▀▀ █▀▄ █▀▀ ▀█▀ ▀█▀ █▀▀
|
|
█ █ ▀ █ █▀█ █▀▀ █▀▄ █▀▀ █ █ █
|
|
▀▀▀ ▀ ▀ ▀ ▀ ▀▀▀ ▀ ▀ ▀▀▀ ▀ ▀▀▀ ▀▀▀</h2><p>Abliterated/Heretic <a href="https://huggingface.co/dphn/Dolphin3.0-Qwen2.5-3b">dphn/Dolphin3.0-Qwen2.5-3b</a>
|
|
|
|
<a href="https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-Dolphin3.0-Qwen2.5-3b">Check Quants</a></br></br>Refusals (this model): 4/100</br>Original (dphn/Dolphin3.0-Qwen2.5-3b): 47/100</br>KL divergence: 0.0804<details><summary>Parameters</summary></br>direction_index = per layer
|
|
</br>attn.o_proj.max_weight = 0.88
|
|
</br>attn.o_proj.max_weight_position = 21.47
|
|
</br>attn.o_proj.min_weight = 0.55
|
|
</br>attn.o_proj.min_weight_distance = 1.60
|
|
</br>mlp.down_proj.max_weight = 1.01
|
|
</br>mlp.down_proj.max_weight_position = 22.57
|
|
</br>mlp.down_proj.min_weight = 0.68
|
|
</br>mlp.down_proj.min_weight_distance = 17.22</details></center></br></br> |