Downloads · 30 days
12
2% of all-time downloads
rlagusrlagus123/XTC4096
XTC4096 is a text generation model from rlagusrlagus123. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
12
2% of all-time downloads
All-time downloads
605
Public
Repo size
2.9 GB
Likes
0
Public
Click a slice to open those files.
.bin1.4 GB · 100%
From the Hugging Face model README
#12 epochs, each batch size 4, gradient accumulation steps 1, tail 4096.
#THIS SEEMS TO BE THE OPTIMAL SETUP.