初始化项目,由ModelHub XC社区提供模型
Model: grimjim/mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1 Source: Original Platform
This commit is contained in:
25
README.md
Normal file
25
README.md
Normal file
@@ -0,0 +1,25 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
- fr
|
||||
- de
|
||||
- es
|
||||
- it
|
||||
- pt
|
||||
- ru
|
||||
- zh
|
||||
- ja
|
||||
base_model:
|
||||
- mistralai/Mistral-Nemo-Instruct-2407
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
---
|
||||
|
||||
# mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1
|
||||
|
||||
MPOA (Magnitude-Preserving Othogonalized Ablation, AKA norm-preserving biprojected abliteration) has been applied the majority of layers in this model, but only to mlp.down_proj.weight layers. Unlike conventional abliteration, self_attn.o_proj.weight layers were left untouched.
|
||||
|
||||
Compliance was not maximized for this model. The model appears to be near an edge of chaos with regard to some safety refusals, which should be suitable for varied text completion.
|
||||
|
||||
More details to follow.
|
||||
Reference in New Issue
Block a user