Downloads · 30 days
65
15% of all-time downloads
sarvam-30b-gguf
ThatCultivator/sarvam-30b-gguf
sarvam-30b-gguf is a text generation model from ThatCultivator. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repository provides the Q4KM quantization of sarvamai/sarvam-30b, an advanced Mixture-of-Experts (MoE) model.
All-time downloads
441
Public
Repo size
19.6 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf19.6 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Mar 9, 2026
- Updated
- Mar 9, 2026
- SHA
- 15c7a9b7
Try a prompt
Base models
Model card
From the Hugging Face model README
Sarvam-30B GGUF (Quantized)
This repository provides the Q4_K_M quantization of sarvamai/sarvam-30b, an advanced Mixture-of-Experts (MoE) model.
By using the GGUF format and 4-bit quantization, the VRAM requirement is reduced significantly, making it runnable on consumer hardware like RTX 3090, or RTX 4090.
Quantization Details
- Method: Q4_K_M (Medium, K-Quants)
- Original Size: ~120 GB
- Quantized Size: ~19 GB
- Architecture: Sarvam MoE
License
This model is a quantized version of sarvamai/sarvam-30b. Both the original model and these weights are released under the Apache License 2.0.
- Task
- Text Generation
- License
- apache-2.0
- Created
- Mar 9, 2026
- Updated
- Mar 9, 2026