karpathy

gpt2_1558M_final2_hf

karpathy/gpt2_1558M_final2_hf

gpt2_1558M_final2_hf is a text generation model from karpathy. Use it when you need the model to write or continue text. It is set up for transformers.

This is a GPT-2 model trained in llm.c, for 32K steps (of 1M batch size) on FineWeb-EDU.