Downloads · 30 days
38
7% of all-time downloads
rachittshah/sarvam-2b-v0.5-GGUF
sarvam-2b-v0.5-GGUF is a text generation model from rachittshah. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is an early checkpoint of sarvam-2b, a small, yet powerful language model pre-trained from scratch on 4 trillion tokens. It is trained to be good at 10 Indic languages + English. Officially, the Indic languages s…
Downloads · 30 days
38
7% of all-time downloads
All-time downloads
556
Public
Repo size
2.1 GB
Likes
1
Public
Click a slice to open those files.
.gguf2.1 GB · 100%
From the Hugging Face model README
This is an early checkpoint of sarvam-2b, a small, yet powerful language model pre-trained from scratch on 4 trillion tokens. It is trained to be good at 10 Indic languages + English. Officially, the Indic languages supported are: Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Oriya, Punjabi, Tamil, and Telugu.
sarvam-2b will be trained on a data mixture containing equal parts English (2T) and Indic (2T) tokens. The current checkpoint has seen a total of 2 trillion tokens, and has not undergone any post-training.
Getting started:
from transformers import pipeline
pipe = pipeline(model='sarvamai/sarvam-2b-v0.5', device=0)
pipe('भारत के प्रथम प्रधानमंत्री', max_new_tokens=15, temperature=0.1, repetition_penalty=1.2)[0]['generated_text']
# 'भारत के प्रथम प्रधानमंत्री जवाहरलाल नेहरू की बेटी इंदिरा गांधी थीं।\n\n'
More technical details like evaluations and benchmarking will be posted soon.