Downloads · 30 days
38
12% of all-time downloads
dlouapre/SmolChessLM_6M_30Mg
SmolChessLM_6M_30Mg is a text generation model from dlouapre. Use it when you need the model to write or continue text. It is set up for transformers.
A 🤗 transformers model playing chess by predicting chess moves, where each move is encoded in a custom explicit format <piece<src<dst, for instance "WPe2e4".
Downloads · 30 days
38
12% of all-time downloads
All-time downloads
324
Public
Parameters
6.1M
48.6 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors24.3 MB · 100%
From the Hugging Face model README
A 🤗 transformers model playing chess by predicting chess moves, where each move is encoded in a custom explicit format <piece><src><dst>, for instance "WPe2e4".
The model is based on the Llama architecture (256 width, 8 heads, 8 layers) and trained over 30 million games from the lichess database.
Tokenizer : dlouapre/chess_tokenizer_pairs, which tokenizes using pairs of characters like "WP" or "e2".
On Lichess games, the model plays with >99% of valid moves, but for a given position, only 45% of the moves are identical to the actual game.