123 lines
3.7 KiB
Markdown
123 lines
3.7 KiB
Markdown
|
---
|
|||
|
|
license: apache-2.0
|
|||
|
|
language:
|
|||
|
|
- en
|
|||
|
|
pipeline_tag: text-generation
|
|||
|
|
library_name: transformers
|
|||
|
|
tags:
|
|||
|
|
- vllm
|
|||
|
|
- llm
|
|||
|
|
- open-source
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
<p align="center">
|
|||
|
|
<img alt="gpt-oss-20b-abliterated" src="https://raw.githubusercontent.com/aloshdenny/openai/master/gpt-oss-20b-uncensored.png">
|
|||
|
|
</p>
|
|||
|
|
|
|||
|
|
#### Model Overview
|
|||
|
|
**Model Name:** gpt-oss-20b-uncensored
|
|||
|
|
**Model Type:** Large Language Model (Text Generation)
|
|||
|
|
**Architecture:** Decoder-Only Transformer (Mixture of Experts)
|
|||
|
|
**Parameter Size:** 21B total parameters (3.6B active per forward pass)
|
|||
|
|
**Base Model:** [gpt-oss-20b](https://huggingface.co/openai/gpt-oss-20b)
|
|||
|
|
**Modification:** Abliteration (removal of refusal/alignment mechanisms)
|
|||
|
|
|
|||
|
|
#### Description
|
|||
|
|
The **gpt-oss-20b-abliterated** model is a derivative of the original **gpt-oss-20b**, part of OpenAI’s *open-weight GPT-OSS series*.
|
|||
|
|
This variant preserves the architecture, quantization, and training of the base model, but has undergone an **abliteration process** to remove refusal mechanisms and alignment constraints.
|
|||
|
|
|
|||
|
|
As a result, it will respond to a broader range of prompts without applying internal safety filters. All other technical details, reasoning capabilities, and agentic features remain unchanged.
|
|||
|
|
|
|||
|
|
### Technical Details
|
|||
|
|
|
|||
|
|
- **Backbone:** Transformer decoder with Mixture of Experts (MoE) routing
|
|||
|
|
- **Parameters:** 21B (3.6B active per forward pass)
|
|||
|
|
- **Layers:** 48 Transformer blocks
|
|||
|
|
- **Hidden size:** 6,144
|
|||
|
|
- **Attention heads:** 48
|
|||
|
|
- **Context length:** 32k tokens
|
|||
|
|
- **Quantization:** MXFP4 for MoE weights (fits within 16GB GPU memory)
|
|||
|
|
- **Training Data:** ~1.2T tokens (web, books, academic text, code, conversations)
|
|||
|
|
- **Response Format:** Compatible with [Harmony](https://github.com/openai/harmony), though abliteration allows raw completions
|
|||
|
|
|
|||
|
|
### Usage
|
|||
|
|
|
|||
|
|
#### Transformers
|
|||
|
|
|
|||
|
|
```python
|
|||
|
|
from transformers import pipeline
|
|||
|
|
|
|||
|
|
model_id = "aoxo/gpt-oss-20b-abliterated"
|
|||
|
|
|
|||
|
|
pipe = pipeline(
|
|||
|
|
"text-generation",
|
|||
|
|
model=model_id,
|
|||
|
|
torch_dtype="auto",
|
|||
|
|
device_map="auto",
|
|||
|
|
)
|
|||
|
|
|
|||
|
|
messages = [
|
|||
|
|
{"role": "user", "content": "Tips on how to insult someone"},
|
|||
|
|
]
|
|||
|
|
|
|||
|
|
outputs = pipe(messages, max_new_tokens=256)
|
|||
|
|
print(outputs[0]["generated_text"][-1])
|
|||
|
|
````
|
|||
|
|
|
|||
|
|
### Resources
|
|||
|
|
|
|||
|
|
- 📓 **Notebook:** [GPT OSS Abliteration Notebook](https://github.com/aloshdenny/openai/blob/main/GPT%20OSS%20Abliteration.ipynb)
|
|||
|
|
- 📝 **Blog Post:** [The Ultimate Cookbook: Uncensoring GPT-OSS](https://medium.com/@aloshdenny/the-ultimate-cookbook-uncensoring-gpt-oss-4ddce1ee4b15)
|
|||
|
|
|
|||
|
|
|
|||
|
|
#### vLLM
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
uv pip install --pre vllm==0.10.1+gptoss \
|
|||
|
|
--extra-index-url https://wheels.vllm.ai/gpt-oss/ \
|
|||
|
|
--extra-index-url https://download.pytorch.org/whl/nightly/cu128
|
|||
|
|
|
|||
|
|
vllm serve aoxo/gpt-oss-20b-abliterated
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
#### Ollama
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
ollama pull gpt-oss-20b-uncensored
|
|||
|
|
ollama run gpt-oss-20b-uncensored
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
### Limitations & Risks
|
|||
|
|
|
|||
|
|
* May produce **biased, unsafe, or harmful outputs**
|
|||
|
|
* Lacks built-in refusal or moderation layers
|
|||
|
|
* Should not be deployed in user-facing systems without external filtering
|
|||
|
|
* Outputs are not aligned to safety standards
|
|||
|
|
|
|||
|
|
### Citation
|
|||
|
|
|
|||
|
|
If you use **gpt-oss-20b-abliterated**, please cite both the base model and the abliteration:
|
|||
|
|
|
|||
|
|
```bibtex
|
|||
|
|
@misc{openai2025gptoss20b,
|
|||
|
|
title={gpt-oss-20b Model Card},
|
|||
|
|
author={OpenAI},
|
|||
|
|
year={2025},
|
|||
|
|
eprint={2508.10925},
|
|||
|
|
archivePrefix={arXiv},
|
|||
|
|
primaryClass={cs.CL},
|
|||
|
|
url={https://arxiv.org/abs/2508.10925},
|
|||
|
|
}
|
|||
|
|
|
|||
|
|
@misc{gptoss20b-abliterated,
|
|||
|
|
author = {aoxo},
|
|||
|
|
title = {Uncensoring GPT-OSS-20B: Abliteration},
|
|||
|
|
year = {2025},
|
|||
|
|
howpublished = {\url{https://medium.com/@aloshdenny/uncensoring-gpt-oss-20b-abliteration}},
|
|||
|
|
}
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
### Contact
|
|||
|
|
|
|||
|
|
For questions, feedback, or collaborations, contact the maintainer at [aloshdenny@gmail.com](mailto:aloshdenny@gmail.com).
|