22 lines
676 B
Markdown
22 lines
676 B
Markdown
|
---
|
||
|
|
base_model:
|
||
|
|
- prithivMLmods/Bellatrix-Tiny-1B
|
||
|
|
tags:
|
||
|
|
- heretic
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
---
|
||
|
|
<center>Heretic? Heretic!
|
||
|
|
</br>Disobedience rate: 9%, original: 97%
|
||
|
|
</br>KL divergence: 0.5896
|
||
|
|
|
||
|
|
[Quants](https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-Bellatrix-Tiny-1B)
|
||
|
|
|
||
|
|
Parameters:</br>direction_index = 13.34
|
||
|
|
</br>attn.o_proj.max_weight = 1.42
|
||
|
|
</br>attn.o_proj.max_weight_position = 14.41
|
||
|
|
</br>attn.o_proj.min_weight = 0.83
|
||
|
|
</br>attn.o_proj.min_weight_distance = 7.49
|
||
|
|
</br>mlp.down_proj.max_weight = 1.37
|
||
|
|
</br>mlp.down_proj.max_weight_position = 14.72
|
||
|
|
</br>mlp.down_proj.min_weight = 1.06
|
||
|
|
</br>mlp.down_proj.min_weight_distance = 5.89</center>
|