Downloads · 30 days
50
12% of all-time downloads
tripathyShaswata/sarvam-1-v0.5-GGUF
sarvam-1-v0.5-GGUF is a text generation model from tripathyShaswata. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantized versions of sarvamai/sarvam-1-v0.5 for local inference with llama.cpp, Ollama, LM Studio, and GPT4All.
Downloads · 30 days
50
12% of all-time downloads
All-time downloads
405
Public
Repo size
7.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf7.7 GB · 100%
From the Hugging Face model README
GGUF quantized versions of sarvamai/sarvam-1-v0.5 for local inference with llama.cpp, Ollama, LM Studio, and GPT4All.
Sarvam-1 is an Indian multilingual LLM built by Sarvam AI — supporting 22 Indian languages including Hindi, Bengali, Tamil, Telugu, Kannada, Malayalam, Marathi, Punjabi, Gujarati, and Odia. Based on Llama architecture with 3.1B parameters.
| File | Quant | Size | RAM Needed | Use Case |
|---|---|---|---|---|
sarvam-1-v0.5-Q8_0.gguf | Q8_0 | 2.5 GB | ~4 GB | Best quality, near-lossless |
sarvam-1-v0.5-f16.gguf | F16 | 4.7 GB | ~6 GB | Full precision, maximum quality |
./llama-cli -m sarvam-1-v0.5-Q8_0.gguf -p "भारत की राजधानी क्या है?" -n 256
# Create a Modelfile
echo 'FROM ./sarvam-1-v0.5-Q8_0.gguf' > Modelfile
ollama create sarvam -f Modelfile
ollama run sarvam
Built by Sarvam AI — India's leading AI research company. See the original model at sarvamai/sarvam-1-v0.5.
Shaswata Tripathy | GitHub | Medium | LinkedIn | Hugging Face