Downloads · 30 days
23
4% of all-time downloads
TinyMistral-248M-v2.5-Instruct-GGUF
ysn-rfd/TinyMistral-248M-v2.5-Instruct-GGUF
TinyMistral-248M-v2.5-Instruct-GGUF is a machine learning model from ysn-rfd. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model was converted to GGUF format from Locutusque/TinyMistral-248M-v2.5-Instruct using llama.cpp via the ggml.ai's all-gguf-same-where space. Refer to the original model card for more details on the model.
All-time downloads
571
Public
Repo size
1.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf1.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 3, 2025
- Updated
- Apr 3, 2025
- SHA
- 7188c6d7
Try a prompt
Base models
Model card
From the Hugging Face model README
ysn-rfd/TinyMistral-248M-v2.5-Instruct-GGUF
This model was converted to GGUF format from Locutusque/TinyMistral-248M-v2.5-Instruct using llama.cpp via the ggml.ai's all-gguf-same-where space.
Refer to the original model card for more details on the model.
✅ Quantized Models Download List
🔍 Recommended Quantizations
- ✨ General CPU Use:
Q4_K_M(Best balance of speed/quality) - 📱 ARM Devices:
Q4_0(Optimized for ARM CPUs) - 🏆 Maximum Quality:
Q8_0(Near-original quality)
📦 Full Quantization Options
| 🚀 Download | 🔢 Type | 📝 Notes |
|---|---|---|
| Download |  | Basic quantization |
| Download |  | Small size |
| Download |  | Balanced quality |
| Download |  | Better quality |
| Download |  | Fast on ARM |
| Download |  | Fast, recommended |
| Download |  ⭐ | Best balance |
| Download |  | Good quality |
| Download |  | Balanced |
| Download |  | High quality |
| Download |  🏆 | Very good quality |
| Download |  ⚡ | Fast, best quality |
| Download |  | Maximum accuracy |
💡 Tip: Use F16 for maximum precision when quality is critical
🚀 Applications and Tools for Locally Quantized LLMs
🖥️ Desktop Applications
| Application | Description | Download Link |
|---|---|---|
| Llama.cpp | A fast and efficient inference engine for GGUF models. | GitHub Repository |
| Ollama | A streamlined solution for running LLMs locally. | Website |
| AnythingLLM | An AI-powered knowledge management tool. | GitHub Repository |
| Open WebUI | A user-friendly web interface for running local LLMs. | GitHub Repository |
| GPT4All | A user-friendly desktop application supporting various LLMs, compatible with GGUF models. | GitHub Repository |
| LM Studio | A desktop application designed to run and manage local LLMs, supporting GGUF format. | Website |
| GPT4All Chat | A chat application compatible with GGUF models for local, offline interactions. | GitHub Repository |
📱 Mobile Applications
| Application | Description | Download Link |
|---|---|---|
| ChatterUI | A simple and lightweight LLM app for mobile devices. | GitHub Repository |
| Maid | Mobile Artificial Intelligence Distribution for running AI models on mobile devices. | GitHub Repository |
| PocketPal AI | A mobile AI assistant powered by local models. | GitHub Repository |
| Layla | A flexible platform for running various AI models on mobile devices. | Website |
🎨 Image Generation Applications
| Application | Description | Download Link |
|---|---|---|
| Stable Diffusion | An open-source AI model for generating images from text. | GitHub Repository |
| Stable Diffusion WebUI | A web application providing access to Stable Diffusion models via a browser interface. | GitHub Repository |
| Local Dream | Android Stable Diffusion with Snapdragon NPU acceleration. Also supports CPU inference. | GitHub Repository |
| Stable-Diffusion-Android (SDAI) | An open-source AI art application for Android devices, enabling digital art creation. | GitHub Repository |
- License
- apache-2.0
- Languages
- en
- Created
- Apr 3, 2025
- Updated
- Apr 3, 2025