Downloads · 30 days
17
5% of all-time downloads
mesolitica/Malaysian-Llama-3.1-8B-Instruct-v0.1
Malaysian-Llama-3.1-8B-Instruct-v0.1 is a machine learning model from mesolitica. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Continue finetuning meta-llama/Llama-3.1-8B-Instruct on highly curated 1.2B tokens Malaysian instruction.
Downloads · 30 days
17
5% of all-time downloads
All-time downloads
372
Public
Parameters
8B
16.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
Continue finetuning meta-llama/Llama-3.1-8B-Instruct on highly curated 1.2B tokens Malaysian instruction.
Model Accuracy shot by_letter category
0 Malaysian-Llama-3.1-8B-Instruct 61.768318 0shot True STEM
1 Malaysian-Llama-3.1-8B-Instruct 62.420483 0shot True Language
2 Malaysian-Llama-3.1-8B-Instruct 60.291992 0shot True Social science
3 Malaysian-Llama-3.1-8B-Instruct 59.270808 0shot True Others
4 Malaysian-Llama-3.1-8B-Instruct 62.366325 0shot True Humanities
{'Social science': 6918, 'Language': 6288, 'Humanities': 4395, 'Others': 4169, 'STEM': 2443}
Model : Malaysian-Llama-3.1-8B-Instruct
Metric : first
Shot : 0shot
average accuracy 61.194399702639075
accuracy for STEM 61.76831764224314
accuracy for Language 62.420483460559794
accuracy for Social science 60.2919919051749
accuracy for Others 59.2708083473255
accuracy for Humanities 62.36632536973834
Finetune on mesolitica/Malaysian-SFT to make the model understand Malaysian context.
["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj", "embed_tokens", "lm_head"].lm_head to reduce memory consumption.Source code at https://github.com/malaysia-ai/cooking/tree/main/llama/sft