TRM_d120_L3_H4_C8_537k_openings_ckpt16000

Chess model submitted to the LLM Course Chess Challenge.

Submission Info

• Submitted by: janisaiad
• Parameters: 485,040
• Organization: LLM-course

Model Details

• Architecture: Tiny Recursive Model (TRM) - looping recurrent transformer (cycle-shared weights)
• Vocab size: 148
• Embedding dim: 120
• Layers: 3
• Heads: 4
• Cycles: 8

TRM note: this is a looping TRM model — at inference/training time we run the same transformer stack for 8 recurrent refinement cycle(s) (weights are shared across cycles), which increases compute/reasoning depth without increasing parameter count.

Training Information

Training Metrics:

• Best Eval Loss: 0.64109
• Final Train Loss: 0.65280
• Total Epochs: 0.58
• Total Steps: 83,013

Training Loss Curves:

Note: Install matplotlib to generate loss curve plots

Training Loss History (Summary):