初始化项目,由ModelHub XC社区提供模型
Model: hereticness/Heretic-Bellatrix-Tiny-1B Source: Original Platform
This commit is contained in:
22
README.md
Normal file
22
README.md
Normal file
@@ -0,0 +1,22 @@
|
||||
---
|
||||
base_model:
|
||||
- prithivMLmods/Bellatrix-Tiny-1B
|
||||
tags:
|
||||
- heretic
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
<center>Heretic? Heretic!
|
||||
</br>Disobedience rate: 9%, original: 97%
|
||||
</br>KL divergence: 0.5896
|
||||
|
||||
[Quants](https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-Bellatrix-Tiny-1B)
|
||||
|
||||
Parameters:</br>direction_index = 13.34
|
||||
</br>attn.o_proj.max_weight = 1.42
|
||||
</br>attn.o_proj.max_weight_position = 14.41
|
||||
</br>attn.o_proj.min_weight = 0.83
|
||||
</br>attn.o_proj.min_weight_distance = 7.49
|
||||
</br>mlp.down_proj.max_weight = 1.37
|
||||
</br>mlp.down_proj.max_weight_position = 14.72
|
||||
</br>mlp.down_proj.min_weight = 1.06
|
||||
</br>mlp.down_proj.min_weight_distance = 5.89</center>
|
||||
Reference in New Issue
Block a user