Downloads · 30 days
0
jonwondo/lilLM_40M_param_10B_tok
lilLM_40M_param_10B_tok is a machine learning model from jonwondo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
A model trained using lilLM: https://github.com/CohleM/lilLM
Downloads · 30 days
0
Access
Public
Updated Feb 21, 2025
Repo size
475 MB
Likes
0
Public
Click a slice to open those files.
.pt475 MB · 100%
From the Hugging Face model README
A model trained using lilLM: https://github.com/CohleM/lilLM
The model is ~40M parameter and trained on 10B tokens from OpenWebText: https://huggingface.co/datasets/Skylion007/openwebtext