66 lines
1.7 KiB
Markdown
66 lines
1.7 KiB
Markdown
---
|
|
base_model:
|
|
- FlareRebellion/WeirdCompound-v1.7-24b
|
|
- OddTheGreat/NeutralGear_24B_V.2
|
|
tags:
|
|
- mistral
|
|
- 24b
|
|
- merge
|
|
- heretic
|
|
- abliterated
|
|
- uncensored
|
|
- roleplay
|
|
- conversational
|
|
license: other
|
|
language:
|
|
- en
|
|
pipeline_tag: text-generation
|
|
---
|
|
|
|
# NeutralWeirdness v1 24B Heretic
|
|
|
|
|
|
|
|
A merge of WeirdCompound v1.7 and NeutralGear V.2, then abliterated
|
|
using Heretic for uncensored output.
|
|
|
|
## Description of This Model
|
|
|
|
This is my first published model. I merged the WeirdCompound v1.7 and NeutralGear V.2 via a 50/50
|
|
SLERP merge, then the refusal direction was removed using Heretic v1.2.0.
|
|
|
|
I havent tested the model too much. but it has a good stable and creative role-playing capability.
|
|
|
|
## Merge Recipe
|
|
|
|
- Method: SLERP 50/50
|
|
- Tool: mergekit
|
|
- Model A: FlareRebellion/WeirdCompound-v1.7-24b
|
|
- Model B: OddTheGreat/NeutralGear_24B_V.2
|
|
|
|
## Abliteration
|
|
|
|
- Tool: [Heretic v1.2.0](https://github.com/p-e-w/heretic)
|
|
- Trial used: Trial 161 (100/100 Refusals to 8/100 refusals, KL divergence 0.0471)
|
|
- Quantization during process: bnb_4bit
|
|
- Device: NVIDIA RTX 3090 24GB
|
|
|
|
## Recommended Settings
|
|
|
|
- Template: Mistral V7 Tekken
|
|
- Sampler: top-p 0.8, min-p: 0.1 temp 0.75
|
|
- Context: up to 32k
|
|
|
|
## Hardware Used
|
|
|
|
- Merge: Ryzen 5 3600, 32GB RAM (CPU only)
|
|
- Abliteration: RTX 3090 24GB
|
|
|
|
## Credits
|
|
|
|
- [mradermacher](https://huggingface.co/mradermacher/NeutralWeirdness-V1-24B-Heretic-GGUF) for Quantization
|
|
- [FlareRebellion](https://huggingface.co/FlareRebellion) for WeirdCompound
|
|
- [OddTheGreat](https://huggingface.co/OddTheGreat) for NeutralGear
|
|
- [FailSpy](https://github.com/FailSpy) for abliterator
|
|
- [p-e-w](https://github.com/p-e-w/heretic) for Heretic
|
|
- [arcee-ai](https://github.com/arcee-ai/mergekit) for mergekit |