OneThinker-8B-AIO-GGUF

OneThinker-8B-AIO-GGUF

The OneThinker-8B model, including the OneThinker-SFT-Qwen3-8B variant, is an all-in-one reasoning model for images and videos based on the Qwen-3-VL-Instruct-8B architecture, optimized for comprehensive multimodal reasoning tasks such as image question answering, video understanding, grounding, tracking, and segmentation. It achieves top-tier performance across a wide range of benchmarks including 70.6% accuracy on MMMU for image QA and strong video QA results, surpassing other leading open-source models like Qwen3-VL-Instruct-8B. The model uses a unified text format to integrate diverse reasoning tasks, enabling advanced STEM, general knowledge, and multimodal reasoning capabilities. It supports large context lengths and has been trained with extensive GPU resources, making it a powerful tool for visual and video reasoning tasks with state-of-the-art results in multimedia understanding and question answering.

OneThinker-8B [GGUF]

OneThinker-SFT-Qwen3-8B [GGUF]

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):