Downloads · 30 days
0
pythia-410m-mates
yuzc19/pythia-410m-mates
pythia-410m-mates is a machine learning model from yuzc19. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Pythia-410M models pre-trained by MATES.
Access
Public
Updated Jul 8, 2024
Repo size
43.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pth43.8 GB · 100%
At a glance
- Access
- Public
- Created
- Jul 8, 2024
- Updated
- Jul 8, 2024
- SHA
- 26beed38
Datasets
Model card
From the Hugging Face model README
Pythia-410M models pre-trained by MATES.
The training step is the iteration divided by 4, i.e., iter-040000-ckpt.pth corresponds to the model checkpoint in step 10000.
Paper: MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models
Official codebase: https://github.com/cxcscmu/MATES
- Created
- Jul 8, 2024
- Updated
- Jul 8, 2024