Downloads · 30 days
0
attiri-llama
adithya-balaji/attiri-llama
attiri-llama is a machine learning model from adithya-balaji. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gpl-3.0.
This repo contains a low-rank adapter for LLaMA-7b fit extended for tamil-language
Access
Public
Updated Apr 4, 2023
Repo size
16.8 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin16.8 MB · 100%
At a glance
- License
- gpl-3.0
- Access
- Public
- Created
- Apr 4, 2023
- Updated
- Apr 4, 2023
- SHA
- bbb5c9ce
Model card
From the Hugging Face model README
This repo contains a low-rank adapter for LLaMA-7b fit extended for tamil-language
This version of the weights was trained with the following hyperparameters:
- Epochs: 2
- Batch size: 128
- Cutoff length: 512
- Learning rate: 3e-4
- Lora r: 16
- Lora target modules: q_proj, k_proj, v_proj, o_proj
Model to be uploaded shortly
- License
- gpl-3.0
- Languages
- en
- Created
- Apr 4, 2023
- Updated
- Apr 4, 2023