Downloads · 30 days
27
2% of all-time downloads
gemma-2b-hindi
KathirKs/gemma-2b-hindi
gemma-2b-hindi is a text generation model from KathirKs. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Gemma-2b-hindi is a transformer model that is continual pretrained using 300 Billion tokens in Hindi using the Gemma-2-2b as the base model.
All-time downloads
1.7K
Public
Parameters
2.5B
15.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5 GB · 99%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- gemma
- Access
- Public
- Created
- Dec 25, 2024
- Updated
- Jan 14, 2025
- SHA
- 99ecadc6
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Gemma-2b-hindi:
Gemma-2b-hindi is a transformer model that is continual pretrained using 300 Billion tokens in Hindi using the Gemma-2-2b as the base model.
Hyperparameters:
learning_rate: 2E-4 # set low for fine-tuning <br> weight_decay: 0.1 <br> min_lr_ratio: 0.00225 <br> warmup: 0.01 <br> decay: 0.99 <br> rewarmup: 0.01 <br>
Code:
The levanter repository is used to train the model on google cloud tpus. <br> Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC) .
Contact:
If you have any queries or issues, reach out to: Kathir
- Task
- Text Generation
- Type
- gemma
- License
- apache-2.0
- Languages
- en, hi
- Created
- Dec 25, 2024
- Updated
- Jan 14, 2025