yuchenj

gpt2_350M_100B_FinewebEdu_wsd_hf

yuchenj/gpt2_350M_100B_FinewebEdu_wsd_hf

gpt2_350M_100B_FinewebEdu_wsd_hf is a text generation model from yuchenj. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This is a GPT-2 (350M) model trained in llm.c for 100B tokens with WSD (Warmup-Stable-Decay) learning rate schedule on FineWeb-EDU.