Downloads · 30 days
5
19% of all-time downloads
TinyNews-28M
GregSamek/TinyNews-28M
TinyNews-28M is a machine learning model from GregSamek. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
For a detailed overview of this project from start to finish, check out GregSamek.github.io/TinyNews
All-time downloads
27
Public
Parameters
27.6M
111 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors110 MB · 100%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Jul 7, 2024
- Updated
- Jul 11, 2024
- SHA
- cde589b0
Datasets
Model card
From the Hugging Face model README
Tiny News
For a detailed overview of this project from start to finish, check out GregSamek.github.io/TinyNews
TinyNews is a collection of one million synthetically generated news bulletins and several language models scratch-trained on this data. Evaluations suggests that TinyNews retains ~80% of the quality of the training data while using ~1/1000th the number of parameters as the models used to generate it.
To run these models, git clone the repository
Trained models and training data are available in this 🤗 Hugging Face Collection
This project is essentially a modified reimplementation of the Microsoft Research TinyStories project.
- Library
- transformers
- Languages
- en
- Created
- Jul 7, 2024
- Updated
- Jul 11, 2024