Downloads · 30 days
8
11% of all-time downloads
adalaw/Llama2-7B-GSM8K-MFT
Llama2-7B-GSM8K-MFT is a text generation model from adalaw. Use it when you need the model to write or continue text. It is set up for transformers.
The model is trained with Masked thought Fine-Tuning (MFT), a simple variant of standard Supervised Fine-Tuning (SFT). You can refer to our code and paper below.
Downloads · 30 days
8
11% of all-time downloads
All-time downloads
71
Public
Parameters
6.7B
27 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors27 GB · 100%
From the Hugging Face model README
The model is trained with Masked thought Fine-Tuning (MFT), a simple variant of standard Supervised Fine-Tuning (SFT). You can refer to our code and paper below.
We test it with the scripts provided in our code.
| Model | GSM8K |
|---|---|
| adalaw/Llama2-7B-GSM8K-SFT | 42.8 |
| adalaw/Llama2-7B-GSM8K-MFT | 47.3 |