Downloads · 30 days
16
7% of all-time downloads
sarathi-qwen2.5-0.5b-instruct-GGUF
DevDPParikh/sarathi-qwen2.5-0.5b-instruct-GGUF
sarathi-qwen2.5-0.5b-instruct-GGUF is a machine learning model from DevDPParikh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
Upstream: Qwen/Qwen2.5-0.5B-Instruct at immutable revision 7ae557604adf67be50417f59c2c2f167def9a775. Conversion and quantization use llama.cpp revision 99f3dc32296f825fec94f202da1e9fede1e78cf9. Converted and quantized…
All-time downloads
227
Public
Repo size
951 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf951 MB · 100%
At a glance
- Library
- llama.cpp
- License
- apache-2.0
- Access
- Public
- Created
- Jul 28, 2026
- Updated
- Jul 28, 2026
- SHA
- 9c8eaa7f
Model card
From the Hugging Face model README
Sarathi GGUF release
Upstream: Qwen/Qwen2.5-0.5B-Instruct at immutable revision 7ae557604adf67be50417f59c2c2f167def9a775.
Conversion and quantization use llama.cpp revision 99f3dc32296f825fec94f202da1e9fede1e78cf9.
Converted and quantized for Sarathi using llama.cpp.
| Quantization | File | Bytes | SHA-256 | Minimum RAM (MiB) | Recommended RAM (MiB) |
|---|---|---|---|---|---|
| Q5_K_M | model-q5_k_m.gguf | 420086080 | 0ba088dcd4d4ee6a6e74848de340b559157da286780487c3c2c510e6c6197730 | 2816 | 3840 |
| Q8_0 | model-q8_0.gguf | 531068224 | 119b718b660a2778fd31dcb737daf867fcdbf0c027b92d4f4b3fbe6772d74621 | 2816 | 3840 |
Limitations
English-only deterministic MVP qualification. Desktop benchmarks are informational; verify physical-device compatibility separately.
- Library
- llama.cpp
- License
- apache-2.0
- Created
- Jul 28, 2026
- Updated
- Jul 28, 2026