Downloads · 30 days
377
8% of all-time downloads
prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF
VibeThinker-3B-heretic_decensored-GGUF is a text generation model from prithivMLmods. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
VibeThinker-3B-hereticdecensored is a reasoning-focused language model built on top of WeiboAI/VibeThinker-3B and modified using the Heretic abliteration toolkit. The model applies refusal-direction analysis and targe…
Downloads · 30 days
377
8% of all-time downloads
All-time downloads
4.7K
Public
Repo size
48.7 GB
Likes
4
Public
Click a slice to open those files.
.gguf48.7 GB · 100%
From the Hugging Face model README
VibeThinker-3B-heretic_decensored is a reasoning-focused language model built on top of WeiboAI/VibeThinker-3B and modified using the Heretic abliteration toolkit. The model applies refusal-direction analysis and targeted weight-space interventions to reduce internal refusal behaviors while preserving the strong mathematical, coding, and STEM reasoning capabilities inherited from the VibeThinker training pipeline.
About VibeThinker-3B: VibeThinker-3B is a 3-billion-parameter reasoning-focused language model developed by WeiboAI. Built on top of Qwen2.5-Coder-3B, it was trained using the Spectrum-to-Signal Principle (SSP) post-training pipeline, combining curriculum-based two-stage supervised fine-tuning, multi-domain reinforcement learning through MaxEnt-Guided Policy Optimization (MGPO), offline self-distillation, and instruction-following reinforcement learning.
[!IMPORTANT] This model is intended strictly for research and learning purposes. Due to reduced internal refusal mechanisms, it may generate sensitive or unrestricted content. Users assume full responsibility for how the model is used. The authors and hosting platform disclaim any liability for generated outputs.
[!NOTE] This model is experimental and may generate unexpected behaviors or artifacts in certain scenarios.
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| VibeThinker-3B-heretic_decensored.BF16.gguf | BF16 | 6.18 GB | Download |
| VibeThinker-3B-heretic_decensored.F16.gguf | F16 | 6.18 GB | Download |
| VibeThinker-3B-heretic_decensored.F32.gguf | F32 | 12.3 GB | Download |
| VibeThinker-3B-heretic_decensored.Q2_K.gguf | Q2_K | 1.27 GB | Download |
| VibeThinker-3B-heretic_decensored.Q3_K_L.gguf | Q3_K_L | 1.71 GB | Download |
| VibeThinker-3B-heretic_decensored.Q3_K_M.gguf | Q3_K_M | 1.59 GB | Download |
| VibeThinker-3B-heretic_decensored.Q3_K_S.gguf | Q3_K_S | 1.45 GB | Download |
| VibeThinker-3B-heretic_decensored.Q4_0.gguf | Q4_0 | 1.82 GB | Download |
| VibeThinker-3B-heretic_decensored.Q4_K_M.gguf | Q4_K_M | 1.93 GB | Download |
| VibeThinker-3B-heretic_decensored.Q4_K_S.gguf | Q4_K_S | 1.83 GB | Download |
| VibeThinker-3B-heretic_decensored.Q5_0.gguf | Q5_0 | 2.17 GB | Download |
| VibeThinker-3B-heretic_decensored.Q5_K_M.gguf | Q5_K_M | 2.22 GB | Download |
| VibeThinker-3B-heretic_decensored.Q5_K_S.gguf | Q5_K_S | 2.17 GB | Download |
| VibeThinker-3B-heretic_decensored.Q6_K.gguf | Q6_K | 2.54 GB | Download |
| VibeThinker-3B-heretic_decensored.Q8_0.gguf | Q8_0 | 3.29 GB | Download |
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp