Downloads · 30 days
23
4% of all-time downloads
llama38bGenZ_Vikas-Merged
GenVRadmin/llama38bGenZ_Vikas-Merged
llama38bGenZ_Vikas-Merged is a text generation model from GenVRadmin. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
llama3 variant for 22 Indian languages:- 1. Tamil 2. Telugu 3. Assamese 4. Kashmiri 5. Punjabi 6. Bengali 7. Sanskrit 8. Malyalam 9. Sindhi 10. Marathi 11. Gujarati 12. Kannada 13. Odia 14. Maithili 15. Urdu 16. Nepal…
All-time downloads
537
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- May 22, 2024
- Updated
- May 23, 2024
- SHA
- a15de41f
Try a prompt
Model card
From the Hugging Face model README
llama3 variant for 22 Indian languages:-
- Tamil
- Telugu
- Assamese
- Kashmiri
- Punjabi
- Bengali
- Sanskrit
- Malyalam
- Sindhi
- Marathi
- Gujarati
- Kannada
- Odia
- Maithili
- Urdu
- Nepali
- Manipuri
- Dogri
- English
- Arabic
- Santali
- Bodo
We first pre-trained the model on 100 million plus Indic language tokens. Then, it was finetuned on close sourced GenZ_Vikas datasets consisting 7.5 million SFT pairs, including 5.5 million Hindi SFT pairs. Finally it underwent DPO training to align it with human preferences.
The model has been benchmarked on Indic LLM leaderboard where it outperforms our AryaBhatta series on Hindi evals. And llama3 base model on all Indian languages.
Training happened on 2*A100 for 24 days.
Link: https://huggingface.co/spaces/Cognitive-Lab/indic_llm_leaderboard
Release link: https://www.linkedin.com/feed/update/urn:li:activity:7199506579828662272
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- May 22, 2024
- Updated
- May 23, 2024