Downloads · 30 days
13
4% of all-time downloads
mesolitica/Malaysian-Qwen2.5-1.5B-Reasoning-SFT
Malaysian-Qwen2.5-1.5B-Reasoning-SFT is a machine learning model from mesolitica. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Continue finetuning https://huggingface.co/mesolitica/Malaysian-Qwen2.5-1.5B-Instruct on highly curated Malaysian Reasoning dataset.
Downloads · 30 days
13
4% of all-time downloads
All-time downloads
299
Public
Parameters
1.8B
7.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7.1 GB · 100%
From the Hugging Face model README
Continue finetuning https://huggingface.co/mesolitica/Malaysian-Qwen2.5-1.5B-Instruct on highly curated Malaysian Reasoning dataset.
Finetune on mesolitica/Malaysian-Reasoning to make the model better reasoning on Malaysian context.
Source code at https://github.com/mesolitica/malaya/tree/master/session/qwen2.5
All the benchmarks generate using vLLM, evaluation based on sacrebleu CHRF max@5.
Source code for evaluation at https://github.com/mesolitica/malaya/tree/master/session/qwen2.5/evaluate-dialect
Dialect to standard Malay,
Standard Malay to dialect,
Source code for evaluation at https://github.com/mesolitica/malaya/tree/master/session/qwen2.5/evaluate-malaymmlu
Evaluation based on Accuracy@1,
Evaluation based on Accuracy@5,
Special thanks to https://www.sns.com.my and Nvidia for 8x H100 node!