Downloads · 30 days
12
2% of all-time downloads
gpt2-chess-lora
chiaraDG/gpt2-chess-lora
gpt2-chess-lora is a machine learning model from chiaraDG. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A GPT-2 model fine-tuned on Lichess chess games to predict the best move given a board position in FEN format.
All-time downloads
489
Public
Parameters
124M
498 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors498 MB · 99%
At a glance
- Model type
- gpt2
- Access
- Public
- Created
- Feb 28, 2026
- Updated
- Feb 28, 2026
- SHA
- 50b4f3c5
Model card
From the Hugging Face model README
GPT-2 Chess LoRA
A GPT-2 model fine-tuned on Lichess chess games to predict the best move given a board position in FEN format.
Training Data
- Dataset: Lichess/standard-chess-games
- Filtered to games where both players are rated > 1800 ELO
- 10000 games used for fine-tuning
Prompt Format
The model expects input in exactly this format:
Board FEN: <fen string>
Best move:
And will complete it with a UCI move like e2e4.
Training
- Base model: openai-community/gpt2
- Fine-tuning method: LoRA (r=8, alpha=16)
- Max steps: 5000
- Learning rate: 5e-4
- Custom tokens added: all 64 board squares as atomic tokens
Usage
This model is used as part of a TransformerPlayer chess agent that scores all legal moves by log-probability and selects the highest scoring one.
- Type
- gpt2
- Languages
- en
- Created
- Feb 28, 2026
- Updated
- Feb 28, 2026