Downloads · 30 days
128
13% of all-time downloads
VibeThinker-3B-GGUF
heath0xFF/VibeThinker-3B-GGUF
VibeThinker-3B-GGUF is a machine learning model from heath0xFF. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF quantizations of WeiboAI/VibeThinker-3B, a Qwen2-based 3B parameter thinking model with 131K context.
All-time downloads
971
Public
Repo size
13.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf13.6 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 16, 2026
- Updated
- Jun 16, 2026
- SHA
- 9feb3d51
Base models
Model card
From the Hugging Face model README
VibeThinker-3B GGUF
GGUF quantizations of WeiboAI/VibeThinker-3B, a Qwen2-based 3B parameter thinking model with 131K context.
Converted with llama.cpp convert_hf_to_gguf.py.
Available Quantizations
| File | Size | BPW | Description |
|---|---|---|---|
VibeThinker-3B-F16.gguf | 5.8 GB | 16.00 | Full FP16 (reference) |
VibeThinker-3B-Q8_0.gguf | 3.1 GB | 8.50 | Near-lossless 8-bit |
VibeThinker-3B-Q5_K_M.gguf | 2.1 GB | 5.75 | High quality 5-bit |
VibeThinker-3B-Q4_K_M.gguf | 1.8 GB | 4.99 | Great size/quality tradeoff |
Usage
llama.cpp
./llama-cli -m VibeThinker-3B-Q4_K_M.gguf -p "Hello!" -n 128
Chat Format
This model uses the Qwen2 chat format with thinking tags:
<|im_start|>system
You are a helpful assistant.<|im_end|>
<|im_start|>user
Hello!<|im_end|>
<|im_start|>assistant
<think>...reasoning...</think>
...response...
<|im_end|>
Model Details
- Architecture: Qwen2ForCausalLM
- Parameters: ~3B
- Layers: 36
- Hidden size: 2048
- Heads: 16 (2 KV heads)
- Context: 131,072 tokens
- Vocab: 151,936
- License
- apache-2.0
- Languages
- en, zh
- Created
- Jun 16, 2026
- Updated
- Jun 16, 2026