Downloads · 30 days
28
1% of all-time downloads
llama3-sinhala
ihalage/llama3-sinhala
llama3-sinhala is a text generation model from ihalage. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
[](https://github.com/ihalage/llama3-sinhala)
All-time downloads
3.8K
Public
Parameters
8B
16.1 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jul 16, 2024
- Updated
- Jul 16, 2024
- SHA
- 7560536d
Model card
From the Hugging Face model README
LLaMA3 (8B) model instruction finetuned to understand and respond in Sinhala language. meta-llama/Meta-Llama-3-8B-Instruct is finetuned on a reletively large dataset in
Sinhala compiled by translating English datasets such as ELI5 and Alpaca. The dataset in hosted in Hugging Face Datasets hub (sinhala-instruction-finetune-large)
The original model is 4-bit quantized and finetuned with a causal language modelling (CLM) objective by adding LoRA adapters with a rank of 16 and a scaling factor of 32.
The finetuned llama3-sinhala model generates better responses in Sinhala compared to the original instruction finetuned model released by Meta.
See the github repo llama3-sinhala for more details.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- si, en
- Featherless Ai
- live
- Created
- Jul 16, 2024
- Updated
- Jul 16, 2024