Undi95/Unholy-8B-DPO-OAS
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Undi95/Unholy-8B-DPO-OAS
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-26 12:46:12 +08:00
commit a824cb955d
16 changed files with 2503 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
README.md Normal file
View File

@@ -0,0 +1,7 @@
This is a TEST
It was made with a custom Orthogonal Activation Steering script I shared HERE : https://huggingface.co/posts/Undi95/318385306588047#663609dc1818d469455c0222 (but be ready to put your hands in some fucked up code bro)
Step :
- First I took Unholy (FT of L3 on Toxic Dataset)
- Then I trained 2 epoch of DPO on top, with the SAME dataset (https://wandb.ai/undis95/Uncensored8BDPO/runs/3rg4rz13/workspace?nw=nwuserundis95)
- Finally, I used OAS on top, bruteforcing the layer to get the best one (I don't really understand all of this, sorry)