Downloads · 30 days
467
3% of all-time downloads
lazy-guy12/chess-llama
chess-llama is a text generation model from lazy-guy12. Use it when you need the model to write or continue text. It is set up for transformers.
We trained a tiny Llama-based decoder-only transformer model for chess play, consisting of 23M parameters. The model is trained on a 3 million high-quality chess games from the Lichess Elite Database, on a single Nvid…
Downloads · 30 days
467
3% of all-time downloads
All-time downloads
15.5K
Public
Parameters
23M
326 MB on disk
Likes
24
Public
Click a slice to open those files.
.onnx257 MB · 74%
From the Hugging Face model README
We trained a tiny Llama-based decoder-only transformer model for chess play, consisting of 23M parameters. The model is trained on a 3 million high-quality chess games from the Lichess Elite Database, on a single Nvidia L4 GPU for 18 hours, using the Google Cloud’s Vertex AI platform.
It uses the UCI format for input and output. It has been trained with the token indicating result appended to the beginning of the games, hoping it would improve performance during actual chess play. The model achieves an estimated Elo rating of 1400, and easily outperforms Skill-level 0 Stockfish.
You can try it out here! It runs directly on your device, within the browser, thanks to transformers.js.
Todo:
Blogpost - https://lazy-guy.github.io/blog/chessllama/