yuchenj

gpt2_124M_100B_FinewebEdu_wsd_hf

yuchenj/gpt2_124M_100B_FinewebEdu_wsd_hf

gpt2_124M_100B_FinewebEdu_wsd_hf is a text generation model from yuchenj. Use it when you need the model to write or continue text. It is set up for transformers.

This is a GPT-2 (124M) model trained in llm.c for 100B tokens with WSD (Warmup-Stable-Decay) learning rate schedule on FineWeb-EDU.