初始化项目,由ModelHub XC社区提供模型
Model: ShyliaSafetensors/NeutralWeirdness-V1-24B-Heretic Source: Original Platform
This commit is contained in:
66
README.md
Normal file
66
README.md
Normal file
@@ -0,0 +1,66 @@
|
||||
---
|
||||
base_model:
|
||||
- FlareRebellion/WeirdCompound-v1.7-24b
|
||||
- OddTheGreat/NeutralGear_24B_V.2
|
||||
tags:
|
||||
- mistral
|
||||
- 24b
|
||||
- merge
|
||||
- heretic
|
||||
- abliterated
|
||||
- uncensored
|
||||
- roleplay
|
||||
- conversational
|
||||
license: other
|
||||
language:
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# NeutralWeirdness v1 24B Heretic
|
||||
|
||||

|
||||
|
||||
A merge of WeirdCompound v1.7 and NeutralGear V.2, then abliterated
|
||||
using Heretic for uncensored output.
|
||||
|
||||
## Description of This Model
|
||||
|
||||
This is my first published model. I merged the WeirdCompound v1.7 and NeutralGear V.2 via a 50/50
|
||||
SLERP merge, then the refusal direction was removed using Heretic v1.2.0.
|
||||
|
||||
I havent tested the model too much. but it has a good stable and creative role-playing capability.
|
||||
|
||||
## Merge Recipe
|
||||
|
||||
- Method: SLERP 50/50
|
||||
- Tool: mergekit
|
||||
- Model A: FlareRebellion/WeirdCompound-v1.7-24b
|
||||
- Model B: OddTheGreat/NeutralGear_24B_V.2
|
||||
|
||||
## Abliteration
|
||||
|
||||
- Tool: [Heretic v1.2.0](https://github.com/p-e-w/heretic)
|
||||
- Trial used: Trial 161 (100/100 Refusals to 8/100 refusals, KL divergence 0.0471)
|
||||
- Quantization during process: bnb_4bit
|
||||
- Device: NVIDIA RTX 3090 24GB
|
||||
|
||||
## Recommended Settings
|
||||
|
||||
- Template: Mistral V7 Tekken
|
||||
- Sampler: top-p 0.8, min-p: 0.1 temp 0.75
|
||||
- Context: up to 32k
|
||||
|
||||
## Hardware Used
|
||||
|
||||
- Merge: Ryzen 5 3600, 32GB RAM (CPU only)
|
||||
- Abliteration: RTX 3090 24GB
|
||||
|
||||
## Credits
|
||||
|
||||
- [mradermacher](https://huggingface.co/mradermacher/NeutralWeirdness-V1-24B-Heretic-GGUF) for Quantization
|
||||
- [FlareRebellion](https://huggingface.co/FlareRebellion) for WeirdCompound
|
||||
- [OddTheGreat](https://huggingface.co/OddTheGreat) for NeutralGear
|
||||
- [FailSpy](https://github.com/FailSpy) for abliterator
|
||||
- [p-e-w](https://github.com/p-e-w/heretic) for Heretic
|
||||
- [arcee-ai](https://github.com/arcee-ai/mergekit) for mergekit
|
||||
Reference in New Issue
Block a user