Downloads · 30 days
55
10% of all-time downloads
OpenThinker2-7B-GGUF
ysn-rfd/OpenThinker2-7B-GGUF
OpenThinker2-7B-GGUF is a machine learning model from ysn-rfd. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
- Base model: open-thoughts/OpenThinker2-7B - License: Apache-2.0
All-time downloads
543
Public
Repo size
17.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf17.8 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Apr 5, 2025
- Updated
- Apr 5, 2025
- SHA
- c674baf5
Base models
Datasets
Model card
From the Hugging Face model README
- Base model: open-thoughts/OpenThinker2-7B
- License: Apache-2.0
Quantized with llama.cpp using all-gguf-same-where
✅ Quantized Models Download List
🔍 Recommended Quantizations
- ✨ General CPU Use:
Q4_K_M(Best balance of speed/quality) - 📱 ARM Devices:
Q4_0(Optimized for ARM CPUs) - 🏆 Maximum Quality:
Q8_0(Near-original quality)
📦 Full Quantization Options
| 🚀 Download | 🔢 Type | 📝 Notes |
|---|---|---|
| Download |  | Basic quantization |
| Download |  | Small size |
| Download |  | Balanced quality |
| Download |  | Better quality |
| Download |  | Fast on ARM |
| Download |  | Fast, recommended |
| Download |  ⭐ | Best balance |
| Download |  | Good quality |
| Download |  | Balanced |
| Download |  | High quality |
| Download |  🏆 | Very good quality |
| Download |  ⚡ | Fast, best quality |
| Download |  | Maximum accuracy |
💡 Tip: Use F16 for maximum precision when quality is critical
🚀 Applications and Tools for Locally Quantized LLMs
🖥️ Desktop Applications
| Application | Description | Download Link |
|---|---|---|
| Llama.cpp | A fast and efficient inference engine for GGUF models. | GitHub Repository |
| Ollama | A streamlined solution for running LLMs locally. | Website |
| AnythingLLM | An AI-powered knowledge management tool. | GitHub Repository |
| Open WebUI | A user-friendly web interface for running local LLMs. | GitHub Repository |
| GPT4All | A user-friendly desktop application supporting various LLMs, compatible with GGUF models. | GitHub Repository |
| LM Studio | A desktop application designed to run and manage local LLMs, supporting GGUF format. | Website |
| GPT4All Chat | A chat application compatible with GGUF models for local, offline interactions. | GitHub Repository |
📱 Mobile Applications
| Application | Description | Download Link |
|---|---|---|
| ChatterUI | A simple and lightweight LLM app for mobile devices. | GitHub Repository |
| Maid | Mobile Artificial Intelligence Distribution for running AI models on mobile devices. | GitHub Repository |
| PocketPal AI | A mobile AI assistant powered by local models. | GitHub Repository |
| Layla | A flexible platform for running various AI models on mobile devices. | Website |
🎨 Image Generation Applications
| Application | Description | Download Link |
|---|---|---|
| Stable Diffusion | An open-source AI model for generating images from text. | GitHub Repository |
| Stable Diffusion WebUI | A web application providing access to Stable Diffusion models via a browser interface. | GitHub Repository |
| Local Dream | Android Stable Diffusion with Snapdragon NPU acceleration. Also supports CPU inference. | GitHub Repository |
| Stable-Diffusion-Android (SDAI) | An open-source AI art application for Android devices, enabling digital art creation. | GitHub Repository |
- Library
- transformers
- License
- apache-2.0
- Created
- Apr 5, 2025
- Updated
- Apr 5, 2025