VibeThinker-3B-GGUF

constructai/VibeThinker-3B-GGUF

This is a quantized version of the original VibeThinker-3B , converted to the GGUF format for efficient CPU/GPU inference with llama.cpp, Ollama, or any GGUF‑compatible runner.

---

Original Model

• Author(s): WeiboAI
• Source: VibeThinker-3B
• Original License: MIT

---

Available Quantizations

Choose the quantization that fits your needs:

For a 3B‑parameter model, even the larger files are quite manageable. Here’s what I recommend: F16 (6.18 GB) or Q8_0 (3.29 GB).

The other quants are also usable!

---

Usage

With ollama

ollama run hf.co/constructai/VibeThinker-3B-GGUF:F16

---

With llama.cpp

llama-server -hf constructai/VibeThinker-3B-GGUF:VibeThinker-3B-GGUF-F16.gguf

or

llama-cli -hf constructai/VibeThinker-3B-GGUF:VibeThinker-3B-GGUF-F16.gguf

---

With LM Studio

lms get constructai/VibeThinker-3B-GGUF@F16

---