Downloads · 30 days
123
7% of all-time downloads
TinySwallow-1.5B-Instruct-GGUF
ysn-rfd/TinySwallow-1.5B-Instruct-GGUF
TinySwallow-1.5B-Instruct-GGUF is a text generation model from ysn-rfd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model was converted to GGUF format from SakanaAI/TinySwallow-1.5B-Instruct using llama.cpp via the ggml.ai's all-gguf-same-where space. Refer to the original model card for more details on the model.
All-time downloads
1.8K
Public
Repo size
7.1 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf7.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Apr 3, 2025
- Updated
- Apr 3, 2025
- SHA
- f8cc9a24
Base models
Model card
From the Hugging Face model README
ysn-rfd/TinySwallow-1.5B-Instruct-GGUF
This model was converted to GGUF format from SakanaAI/TinySwallow-1.5B-Instruct using llama.cpp via the ggml.ai's all-gguf-same-where space.
Refer to the original model card for more details on the model.
✅ Quantized Models Download List
🔍 Recommended Quantizations
- ✨ General CPU Use:
Q4_K_M(Best balance of speed/quality) - 📱 ARM Devices:
Q4_0(Optimized for ARM CPUs) - 🏆 Maximum Quality:
Q8_0(Near-original quality)
📦 Full Quantization Options
| 🚀 Download | 🔢 Type | 📝 Notes |
|---|---|---|
| Download |  | Basic quantization |
| Download |  | Small size |
| Download |  | Balanced quality |
| Download |  | Better quality |
| Download |  | Fast on ARM |
| Download |  | Fast, recommended |
| Download |  ⭐ | Best balance |
| Download |  | Good quality |
| Download |  | Balanced |
| Download |  | High quality |
| Download |  🏆 | Very good quality |
| Download |  ⚡ | Fast, best quality |
| Download |  | Maximum accuracy |
💡 Tip: Use F16 for maximum precision when quality is critical
🚀 Applications and Tools for Locally Quantized LLMs
🖥️ Desktop Applications
| Application | Description | Download Link |
|---|---|---|
| Llama.cpp | A fast and efficient inference engine for GGUF models. | GitHub Repository |
| Ollama | A streamlined solution for running LLMs locally. | Website |
| AnythingLLM | An AI-powered knowledge management tool. | GitHub Repository |
| Open WebUI | A user-friendly web interface for running local LLMs. | GitHub Repository |
| GPT4All | A user-friendly desktop application supporting various LLMs, compatible with GGUF models. | GitHub Repository |
| LM Studio | A desktop application designed to run and manage local LLMs, supporting GGUF format. | Website |
| GPT4All Chat | A chat application compatible with GGUF models for local, offline interactions. | GitHub Repository |
📱 Mobile Applications
| Application | Description | Download Link |
|---|---|---|
| ChatterUI | A simple and lightweight LLM app for mobile devices. | GitHub Repository |
| Maid | Mobile Artificial Intelligence Distribution for running AI models on mobile devices. | GitHub Repository |
| PocketPal AI | A mobile AI assistant powered by local models. | GitHub Repository |
| Layla | A flexible platform for running various AI models on mobile devices. | Website |
🎨 Image Generation Applications
| Application | Description | Download Link |
|---|---|---|
| Stable Diffusion | An open-source AI model for generating images from text. | GitHub Repository |
| Stable Diffusion WebUI | A web application providing access to Stable Diffusion models via a browser interface. | GitHub Repository |
| Local Dream | Android Stable Diffusion with Snapdragon NPU acceleration. Also supports CPU inference. | GitHub Repository |
| Stable-Diffusion-Android (SDAI) | An open-source AI art application for Android devices, enabling digital art creation. | GitHub Repository |
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- ja
- Created
- Apr 3, 2025
- Updated
- Apr 3, 2025