初始化项目,由ModelHub XC社区提供模型
Model: unsloth/gpt-oss-safeguard-20b-GGUF Source: Original Platform
This commit is contained in:
64
.gitattributes
vendored
Normal file
64
.gitattributes
vendored
Normal file
@@ -0,0 +1,64 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zstandard filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.db* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ark* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
|
||||||
|
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
|
||||||
|
*.ggml filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.llamafile* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
|
||||||
|
gpt-oss-safeguard-20b-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
gpt-oss-safeguard-20b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
71
README.md
Normal file
71
README.md
Normal file
@@ -0,0 +1,71 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
library_name: transformers
|
||||||
|
tags:
|
||||||
|
- vllm
|
||||||
|
- unsloth
|
||||||
|
base_model:
|
||||||
|
- openai/gpt-oss-safeguard-20b
|
||||||
|
base_model_relation: quantized
|
||||||
|
---
|
||||||
|
<div>
|
||||||
|
<p style="margin-top: 0;margin-bottom: 0;">
|
||||||
|
<em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
|
||||||
|
</p>
|
||||||
|
<div style="display: flex; gap: 5px; align-items: center; ">
|
||||||
|
<a href="https://github.com/unslothai/unsloth/">
|
||||||
|
<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
|
||||||
|
</a>
|
||||||
|
<a href="https://discord.gg/unsloth">
|
||||||
|
<img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
|
||||||
|
</a>
|
||||||
|
<a href="https://docs.unsloth.ai/">
|
||||||
|
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
||||||
|
</a>
|
||||||
|
</div>
|
||||||
|
</div>
|
||||||
|
|
||||||
|
|
||||||
|
<p align="center">
|
||||||
|
<img alt="gpt-oss-safeguard-20b" src="https://raw.githubusercontent.com/openai/gpt-oss-safeguard/main/docs/gpt-oss-safeguard-20b.png">
|
||||||
|
</p>
|
||||||
|
<p align="center">
|
||||||
|
<a href="https://huggingface.co/spaces/openai/gpt-oss-safeguard-20b"><strong>Try gpt-oss-safeguard</strong></a> ·
|
||||||
|
<a href="https://cookbook.openai.com/articles/gpt-oss-safeguard-guide"><strong>Guide</strong></a> ·
|
||||||
|
<a href="https://arxiv.org/abs/2508.10925"><strong>Model card</strong></a> ·
|
||||||
|
<a href="https://openai.com/index/introducing-gpt-oss-safeguard/"><strong>OpenAI blog</strong></a>
|
||||||
|
</p>
|
||||||
|
|
||||||
|
<br>
|
||||||
|
|
||||||
|
`gpt-oss-safeguard-120b` and `gpt-oss-safeguard-20b` are safety reasoning models built-upon gpt-oss. With these models, you can classify text content based on safety policies that you provide and perform a suite of foundational safety tasks. These models are intended for safety use cases. For other applications, we recommend using [gpt-oss models](https://huggingface.co/collections/openai/gpt-oss).
|
||||||
|
|
||||||
|
This model `gpt-oss-safeguard-20b` (21B parameters with 3.6B active parameters) fits into GPUs with 16GB of VRAM. Check out [`gpt-oss-safeguard-120b`](https://huggingface.co/openai/gpt-oss-safeguard-120b) (117B parameters with 5.1B active parameters) for the larger model.
|
||||||
|
|
||||||
|
Both models were trained on our [harmony response format](https://github.com/openai/harmony) and should only be used with the harmony format as it will not work correctly otherwise.
|
||||||
|
|
||||||
|
## Highlights
|
||||||
|
|
||||||
|
* **Trained to reason about safety** : Trained and tuned for safety reasoning to accommodate use cases like LLM input-output filtering, online content labeling and offline labeling for Trust and Safety use cases.
|
||||||
|
* **Bring your own policy:** Interprets your written policy, so it generalizes across products and use cases with minimal engineering.
|
||||||
|
* **Reasoned decisions, not just scores:** Gain complete access to the model’s reasoning process, facilitating easier debugging and increased trust in policy decisions. Keep in mind Raw CoT is meant for developers and safety practitioners. It’s not intended for exposure to general users or use cases outside of safety contexts.
|
||||||
|
* **Configurable reasoning effort:** Easily adjust the reasoning effort (low, medium, high) based on your specific use case and latency needs.
|
||||||
|
* **Permissive Apache 2.0 license:** Build freely without copyleft restrictions or patent risk—ideal for experimentation, customization, and commercial deployment.
|
||||||
|
|
||||||
|
## Inference examples
|
||||||
|
|
||||||
|
You can use gpt-oss-safeguard-120b and gpt-oss-safeguard-20b similar to gpt-oss-120b and gpt-oss-20b as described in our [respective cookbooks](https://cookbook.openai.com/topic/gpt-oss). We’ve also provided a detailed [prompting guide](https://cookbook.openai.com/articles/gpt-oss-safeguard-guide) that provides guidelines for how to craft your policy and use it with the models.
|
||||||
|
|
||||||
|
## Download the model
|
||||||
|
|
||||||
|
To download the model weights from [Hugging Face hub](https://huggingface.co/collections/openai/gpt-oss-safeguard) using [similar instructions](https://huggingface.co/openai/gpt-oss-120b#download-the-model) to gpt-oss-120b.
|
||||||
|
|
||||||
|
## Join the ROOST Model Community
|
||||||
|
|
||||||
|
gpt-oss-safeguard is a model partner of the [Robust Open Online Safety Tools (ROOST)](http://roost.tools/) Model Community. The ROOST Model Community (RMC) is a group of safety practitioners exploring open source AI models to protect online spaces. As an RMC model partner, OpenAI is committed to incorporating user feedback and jointly iterating on future releases in pursuit of open safety. Visit the [RMC GitHub repo](https://github.com/roostorg/open-models) to learn more about this partnership and how to get involved.
|
||||||
|
|
||||||
|
## Resources
|
||||||
|
|
||||||
|
* [Try gpt-oss-safeguard](https://huggingface.co/spaces/openai/gpt-oss-safeguard-20b)
|
||||||
|
* [OpenAI blog](https://openai.com/index/introducing-gpt-oss-safeguard/)
|
||||||
1
configuration.json
Normal file
1
configuration.json
Normal file
@@ -0,0 +1 @@
|
|||||||
|
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}
|
||||||
3
gpt-oss-safeguard-20b-F16.gguf
Normal file
3
gpt-oss-safeguard-20b-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1515212172e3acbf6ab89a8ed3467fbedeac27c29ce28649de1509662fbe6475
|
||||||
|
size 13792638880
|
||||||
3
gpt-oss-safeguard-20b-Q2_K.gguf
Normal file
3
gpt-oss-safeguard-20b-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5e7e15bfa009d5b0e940a0d31807f58cbccb4e3dee3e6e4ea072cf36df9c44b4
|
||||||
|
size 11468317632
|
||||||
3
gpt-oss-safeguard-20b-Q2_K_L.gguf
Normal file
3
gpt-oss-safeguard-20b-Q2_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8ece1bd3a20e6c04e32dd7efd40f70a95d8d1ba70d159c1176936fb9a3a69790
|
||||||
|
size 11757884352
|
||||||
3
gpt-oss-safeguard-20b-Q3_K_M.gguf
Normal file
3
gpt-oss-safeguard-20b-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a5a9f7caa84c7eeb32c785c9716d5b9473e5ae8cd96cdc2dcee486c4f6f2e1db
|
||||||
|
size 11506103232
|
||||||
3
gpt-oss-safeguard-20b-Q3_K_S.gguf
Normal file
3
gpt-oss-safeguard-20b-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:addb58f117cc8255340792ed7a12fa38fef5c7dd85585a675dc14cdb28dd5ec1
|
||||||
|
size 11463893952
|
||||||
3
gpt-oss-safeguard-20b-Q4_0.gguf
Normal file
3
gpt-oss-safeguard-20b-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0a9471951944c91c2286fc202cb7ccbd849bc89f274304f50d37b59ceec3a5a9
|
||||||
|
size 11501495232
|
||||||
3
gpt-oss-safeguard-20b-Q4_1.gguf
Normal file
3
gpt-oss-safeguard-20b-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fe1391999c69c93a580cf5ab4116b06f5e2d6826ec092349ab16c9d4f5625039
|
||||||
|
size 11577504192
|
||||||
3
gpt-oss-safeguard-20b-Q4_K_M.gguf
Normal file
3
gpt-oss-safeguard-20b-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7c70a6d00294bafb0a118d4deb1697ee8cf0cef8e65dc5dedcc25cbbe4699bad
|
||||||
|
size 11624759232
|
||||||
3
gpt-oss-safeguard-20b-Q4_K_S.gguf
Normal file
3
gpt-oss-safeguard-20b-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bfd164d855b599d3cc19581d12bd06370f5f96e382aa41df39363d5ae7c8021c
|
||||||
|
size 11618492352
|
||||||
3
gpt-oss-safeguard-20b-Q5_K_M.gguf
Normal file
3
gpt-oss-safeguard-20b-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:744eeac466eb03e1966f5cd3d0c55d068653d9fc24b507fae6672b71ce14cabf
|
||||||
|
size 11717356992
|
||||||
3
gpt-oss-safeguard-20b-Q5_K_S.gguf
Normal file
3
gpt-oss-safeguard-20b-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dd2d7ded5df90d39f58dd3487d382648c8946e0fdfda99e3a3787acb5670634b
|
||||||
|
size 11711827392
|
||||||
3
gpt-oss-safeguard-20b-Q6_K.gguf
Normal file
3
gpt-oss-safeguard-20b-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dc6dbe1445cd1628ffc7a84ee4c7c6fb4d8082962dee8e193c390efab950df1d
|
||||||
|
size 12040999872
|
||||||
3
gpt-oss-safeguard-20b-Q8_0.gguf
Normal file
3
gpt-oss-safeguard-20b-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d78461375a173961e2f1f1c809706e478beca06ddb2eb74e2493b323ffa3a36d
|
||||||
|
size 12109566912
|
||||||
3
gpt-oss-safeguard-20b-UD-Q4_K_XL.gguf
Normal file
3
gpt-oss-safeguard-20b-UD-Q4_K_XL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:18f85151a41f9b1abed10ff8875b07cbe259dce58b7ae19c77b1727d2c4ecf71
|
||||||
|
size 11865711552
|
||||||
3
gpt-oss-safeguard-20b-UD-Q6_K_XL.gguf
Normal file
3
gpt-oss-safeguard-20b-UD-Q6_K_XL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dc6dbe1445cd1628ffc7a84ee4c7c6fb4d8082962dee8e193c390efab950df1d
|
||||||
|
size 12040999872
|
||||||
3
gpt-oss-safeguard-20b-UD-Q8_K_XL.gguf
Normal file
3
gpt-oss-safeguard-20b-UD-Q8_K_XL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:51011b84131acd4a78e786d70d6db4c0ff1e4b179f49db3c12e6204b71a079ab
|
||||||
|
size 13195442112
|
||||||
Reference in New Issue
Block a user