Downloads · 30 days
28
17% of all-time downloads
Llama-3.1-MIG-Tulu-3-8B-SFT
xsample/Llama-3.1-MIG-Tulu-3-8B-SFT
Llama-3.1-MIG-Tulu-3-8B-SFT is a text generation model from xsample. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Project | Github | Paper | HuggingFace's collection
All-time downloads
169
Public
Parameters
8B
16.1 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Apr 17, 2025
- Updated
- Apr 24, 2025
- SHA
- 0deaf1b0
Try a prompt
Base models
Model card
From the Hugging Face model README
Llama-3.1-MIG-Tulu-3-8B-SFT
Project | Github | Paper | HuggingFace's collection
Llama-3.1-MIG-Tulu-3-8B-SFT is fine-tuned on automatically selected 50K data.
Performance
| Method | Data Size | ARC | BBH | GSM | HE | MMLU | IFEval | Avg_obj | AE | MT | Wild | Avg_sub | Avg |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Pool | 939K | 69.15 | 63.88 | 83.40 | 63.41 | 65.77 | 67.10 | 68.79 | 8.94 | 6.86 | -24.66 | 38.40 | 53.59 |
| Random | 50K | 74.24 | 64.80 | 70.36 | 51.22 | 63.86 | 61.00 | 64.25 | 8.57 | <u>7.06</u> | -22.15 | 39.36 | 51.81 |
| ZIP | 50K | 77.63 | 63.00 | 52.54 | 35.98 | 65.00 | 61.00 | 59.19 | 6.71 | 6.64 | -32.10 | 35.69 | 47.44 |
| IFD | 50K | 75.93 | 63.56 | 61.03 | 49.39 | 64.39 | 53.60 | 61.32 | 12.30 | 7.03 | -20.20 | 40.83 | 51.08 |
| #InsTag | 50K | 72.54 | 64.80 | 69.83 | 48.17 | 63.50 | 65.99 | 64.14 | 6.58 | 6.84 | -20.70 | 38.21 | 51.17 |
| DEITA | 50K | 78.98 | 66.11 | 74.07 | 49.39 | 64.00 | 64.33 | <u>66.15</u> | 10.19 | 6.83 | <u>-19.95</u> | 39.50 | 52.83 |
| CaR | 50K | 78.98 | 69.04 | 71.42 | 52.44 | 65.15 | 56.75 | 65.63 | 12.55 | 6.95 | -20.67 | 40.57 | 53.10 |
| QDIT | 50K | <u>79.66</u> | 65.42 | 70.74 | <u>53.05</u> | <u>65.06</u> | 57.30 | 65.21 | 15.78 | 6.76 | -20.56 | <u>41.03</u> | <u>53.12</u> |
| MIG | 50K | 80.00 | <u>66.39</u> | <u>72.02</u> | 57.93 | 64.44 | <u>65.06</u> | 67.64 | <u>14.66</u> | 7.32 | -17.77 | 42.99 | 55.32 |
Citation
@article{chen2025mig,
title={MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Space},
author={Chen, Yicheng and Li, Yining and Hu, Kai and Ma, Zerun and Ye, Haochen and Chen, Kai},
journal={arXiv preprint arXiv:2504.13835},
year={2025}
}
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Apr 17, 2025
- Updated
- Apr 24, 2025