AIChess-8B-5DE-EXL2

Model Card for Model ID

Model Type: Exllamav2 4bit

Description

Model finetuned for five epochs on the Lasserino/AIChess dataset.

The dataset consists of over 1500 high ELO games, with each move shown in both chess notatio and an ASCII graphical representation of the board, ex:

. . k . . . . r p p . b . r p . . . . . p . . . . . . p P . q . . P p N . n . . P . P . . . R P . . B . . P . P . . . . R Q . K

Tags are used to more precisely imprint behaviour. An example of this is when we're displaying the previous round's chess board state and the current round's chess board state. When we do that we use the tags [previous_chessboard]chessboard[/previous_chessboard] and [current_chessboard]chessboard[/current_chessboard] in an effort to further separate the representations of the current chess board and previous chess board in the high-dimensional space of the language model's learned knowledge.

The Prompt Format

<pre> <|start_header_id|>user<|end_header_id|> ------------------------------------------------------------------------------------------------------------------------------------------ We are playing a game of chess. When given the current state of the chess board, you must respond with your next move in chess notation (e.g., 'Qdc8#', 'R2xb3', 'Rfc3+'). The chess board will be represented as follows: - Uppercase letters represent white pieces - Lowercase letters represent black pieces - '.' represents an empty square When replying with a move, use standard chess notation (e.g., formatted_examples). Additionally, provide a brief thought process behind your move, considering factors such as: - Attacking opponent's pieces - Defending your own pieces - Controlling key squares - Improving piece positioning - Exploiting opponent's weaknesses - Planning for future moves Use the following format for your response: [current_move]your_move[/current_move] [thought_process]your_thought_process[/thought_process] ------------------------------------------------------------------------------------------------------------------------------------------ [round_number]26[/round_number] [current_turn]Black[/current_turn] [previous_move]Rh8[/previous_move] [previous_chessboard] . . k . . . . r p p . b . r p . . . . . p . . . . . . p P . q . . P p N . n . . P . P . R . . P . . B . . P . P . . . . R Q . K [/previous_chessboard] [my_move]Rg3[/my_move] [current_chessboard] . . k . . . . r p p . b . r p . . . . . p . . . . . . p P . q . . P p N . n . . P . P . . . R P . . B . . P . P . . . . R Q . K [/current_chessboard] [eval_score]0.02[/eval_score] [clock_time]0:00:50[/clock_time] Your move: </pre>