57 lines
4.9 KiB
Markdown
57 lines
4.9 KiB
Markdown
---
|
|
base_model:
|
|
- prithivMLmods/VibeThinker-3B-heretic_decensored
|
|
tags:
|
|
- llama-cpp
|
|
- text-generation-inference
|
|
- math
|
|
- code
|
|
- reasoning
|
|
- gpqa
|
|
- instruction-following
|
|
- heretic
|
|
- uncensored
|
|
- decensored
|
|
- abliterated
|
|
pipeline_tag: text-generation
|
|
license: apache-2.0
|
|
language:
|
|
- en
|
|
library_name: transformers
|
|
---
|
|
|
|
# **VibeThinker-3B-heretic_decensored-GGUF**
|
|
|
|
> VibeThinker-3B-heretic_decensored is a reasoning-focused language model built on top of WeiboAI/VibeThinker-3B and modified using the Heretic abliteration toolkit. The model applies refusal-direction analysis and targeted weight-space interventions to reduce internal refusal behaviors while preserving the strong mathematical, coding, and STEM reasoning capabilities inherited from the VibeThinker training pipeline.
|
|
|
|
> About VibeThinker-3B: VibeThinker-3B is a 3-billion-parameter reasoning-focused language model developed by WeiboAI. Built on top of Qwen2.5-Coder-3B, it was trained using the Spectrum-to-Signal Principle (SSP) post-training pipeline, combining curriculum-based two-stage supervised fine-tuning, multi-domain reinforcement learning through MaxEnt-Guided Policy Optimization (MGPO), offline self-distillation, and instruction-following reinforcement learning.
|
|
|
|
> [!IMPORTANT]
|
|
> This model is intended strictly for research and learning purposes. Due to reduced internal refusal mechanisms, it may generate sensitive or unrestricted content. Users assume full responsibility for how the model is used. The authors and hosting platform disclaim any liability for generated outputs.
|
|
|
|
> [!NOTE]
|
|
> This model is experimental and may generate unexpected behaviors or artifacts in certain scenarios.
|
|
|
|
## Model Files
|
|
|
|
File Name | Quant Type | File Size | File Link |
|
|
|-----------|------------|-----------|-----------|
|
|
| VibeThinker-3B-heretic_decensored.BF16.gguf | BF16 | 6.18 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.BF16.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.F16.gguf | F16 | 6.18 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.F16.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.F32.gguf | F32 | 12.3 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.F32.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q2_K.gguf | Q2_K | 1.27 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q2_K.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q3_K_L.gguf | Q3_K_L | 1.71 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q3_K_L.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q3_K_M.gguf | Q3_K_M | 1.59 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q3_K_M.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q3_K_S.gguf | Q3_K_S | 1.45 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q3_K_S.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q4_0.gguf | Q4_0 | 1.82 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q4_0.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q4_K_M.gguf | Q4_K_M | 1.93 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q4_K_M.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q4_K_S.gguf | Q4_K_S | 1.83 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q4_K_S.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q5_0.gguf | Q5_0 | 2.17 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q5_0.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q5_K_M.gguf | Q5_K_M | 2.22 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q5_K_M.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q5_K_S.gguf | Q5_K_S | 2.17 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q5_K_S.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q6_K.gguf | Q6_K | 2.54 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q6_K.gguf) |
|
|
| VibeThinker-3B-heretic_decensored.Q8_0.gguf | Q8_0 | 3.29 GB | [Download](https://huggingface.co/prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF/blob/main/VibeThinker-3B-heretic_decensored.Q8_0.gguf) |
|
|
|
|
## llama.cpp
|
|
|
|
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp |