Heretic-Bellatrix-Tiny-1B/README.md

base_model, tags, pipeline_tag

base_model	tags	pipeline_tag
prithivMLmods/Bellatrix-Tiny-1B	heretic	text-generation

Heretic? Heretic!
Disobedience rate: 9%, original: 97%
KL divergence: 0.5896

Quants

Parameters:
direction_index = 13.34
attn.o_proj.max_weight = 1.42
attn.o_proj.max_weight_position = 14.41
attn.o_proj.min_weight = 0.83
attn.o_proj.min_weight_distance = 7.49
mlp.down_proj.max_weight = 1.37
mlp.down_proj.max_weight_position = 14.72
mlp.down_proj.min_weight = 1.06
mlp.down_proj.min_weight_distance = 5.89