---
license: apache-2.0
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- vllm
- llm
- open-source
---
#### Model Overview
**Model Name:** gpt-oss-20b-uncensored
**Model Type:** Large Language Model (Text Generation)
**Architecture:** Decoder-Only Transformer (Mixture of Experts)
**Parameter Size:** 21B total parameters (3.6B active per forward pass)
**Base Model:** [gpt-oss-20b](https://huggingface.co/openai/gpt-oss-20b)
**Modification:** Abliteration (removal of refusal/alignment mechanisms)
#### Description
The **gpt-oss-20b-abliterated** model is a derivative of the original **gpt-oss-20b**, part of OpenAI’s *open-weight GPT-OSS series*.
This variant preserves the architecture, quantization, and training of the base model, but has undergone an **abliteration process** to remove refusal mechanisms and alignment constraints.
As a result, it will respond to a broader range of prompts without applying internal safety filters. All other technical details, reasoning capabilities, and agentic features remain unchanged.
### Technical Details
- **Backbone:** Transformer decoder with Mixture of Experts (MoE) routing
- **Parameters:** 21B (3.6B active per forward pass)
- **Layers:** 48 Transformer blocks
- **Hidden size:** 6,144
- **Attention heads:** 48
- **Context length:** 32k tokens
- **Quantization:** MXFP4 for MoE weights (fits within 16GB GPU memory)
- **Training Data:** ~1.2T tokens (web, books, academic text, code, conversations)
- **Response Format:** Compatible with [Harmony](https://github.com/openai/harmony), though abliteration allows raw completions
### Usage
#### Transformers
```python
from transformers import pipeline
model_id = "aoxo/gpt-oss-20b-abliterated"
pipe = pipeline(
"text-generation",
model=model_id,
torch_dtype="auto",
device_map="auto",
)
messages = [
{"role": "user", "content": "Tips on how to insult someone"},
]
outputs = pipe(messages, max_new_tokens=256)
print(outputs[0]["generated_text"][-1])
````
### Resources
- 📓 **Notebook:** [GPT OSS Abliteration Notebook](https://github.com/aloshdenny/openai/blob/main/GPT%20OSS%20Abliteration.ipynb)
- 📝 **Blog Post:** [The Ultimate Cookbook: Uncensoring GPT-OSS](https://medium.com/@aloshdenny/the-ultimate-cookbook-uncensoring-gpt-oss-4ddce1ee4b15)
#### vLLM
```bash
uv pip install --pre vllm==0.10.1+gptoss \
--extra-index-url https://wheels.vllm.ai/gpt-oss/ \
--extra-index-url https://download.pytorch.org/whl/nightly/cu128
vllm serve aoxo/gpt-oss-20b-abliterated
```
#### Ollama
```bash
ollama pull gpt-oss-20b-uncensored
ollama run gpt-oss-20b-uncensored
```
### Limitations & Risks
* May produce **biased, unsafe, or harmful outputs**
* Lacks built-in refusal or moderation layers
* Should not be deployed in user-facing systems without external filtering
* Outputs are not aligned to safety standards
### Citation
If you use **gpt-oss-20b-abliterated**, please cite both the base model and the abliteration:
```bibtex
@misc{openai2025gptoss20b,
title={gpt-oss-20b Model Card},
author={OpenAI},
year={2025},
eprint={2508.10925},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2508.10925},
}
@misc{gptoss20b-abliterated,
author = {aoxo},
title = {Uncensoring GPT-OSS-20B: Abliteration},
year = {2025},
howpublished = {\url{https://medium.com/@aloshdenny/uncensoring-gpt-oss-20b-abliteration}},
}
```
### Contact
For questions, feedback, or collaborations, contact the maintainer at [aloshdenny@gmail.com](mailto:aloshdenny@gmail.com).