yuchenj

gpt2_124M_100B_FinewebEdu_hf

yuchenj/gpt2_124M_100B_FinewebEdu_hf

gpt2_124M_100B_FinewebEdu_hf is a text generation model from yuchenj. Use it when you need the model to write or continue text. It is set up for transformers.

This is a GPT-2 (124M) model trained in llm.c for 100B tokens with cosine LR on Fineweb-Edu.