Downloads · 30 days
9
12% of all-time downloads
adalaw/MAmmoTH-7B-Mistral-MFT
MAmmoTH-7B-Mistral-MFT is a text generation model from adalaw. Use it when you need the model to write or continue text. It is set up for transformers.
The model is trained with Masked Thought Fine-Tuning (MFT), a simple variant of standard Supervised Fine-Tuning (SFT). You can refer to our code and paper below.
Downloads · 30 days
9
12% of all-time downloads
All-time downloads
76
Public
Parameters
7.2B
29 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors29 GB · 100%
From the Hugging Face model README
The model is trained with Masked Thought Fine-Tuning (MFT), a simple variant of standard Supervised Fine-Tuning (SFT). You can refer to our code and paper below.
We test it with the Hybrid decoding scripts provided in MAmmoTH.
| Model | GSM8K | MATH |
|---|---|---|
| adalaw/MAmmoTH-7B-Mistral-MFT | 77.10 | 41.2 |
| TIGER-Lab/MAmmoTH-7B-Mistral-SFT | 75.00 | 40.0 |