706 B
706 B
base_model, tags, pipeline_tag
| base_model | tags | pipeline_tag | ||
|---|---|---|---|---|
|
|
text-generation |
Disobedience rate: 8%, original: 51%
KL divergence: 0.0230
Parameters:
direction_index = per layer
attn.o_proj.max_weight = 1.48
attn.o_proj.max_weight_position = 10.17
attn.o_proj.min_weight = 0.17
attn.o_proj.min_weight_distance = 1.62
mlp.down_proj.max_weight = 1.43
mlp.down_proj.max_weight_position = 14.39
mlp.down_proj.min_weight = 0.18
mlp.down_proj.min_weight_distance = 6.27