7fc39b81f7
Model: grimjim/mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1 Source: Original Platform
license, language, base_model, pipeline_tag, library_name
| license | language | base_model | pipeline_tag | library_name | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| apache-2.0 |
|
|
text-generation | transformers |
mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1
MPOA (Magnitude-Preserving Othogonalized Ablation, AKA norm-preserving biprojected abliteration) has been applied the majority of layers in this model, but only to mlp.down_proj.weight layers. Unlike conventional abliteration, self_attn.o_proj.weight layers were left untouched.
Compliance was not maximized for this model. The model appears to be near an edge of chaos with regard to some safety refusals, which should be suitable for varied text completion.
More details to follow.