"Trenton Bricken cited OthelloGPT as evidence that a transformer can learn a board representation from legal move sequences."
At about 01:33, Bricken describes Othello as an interpretability example in which a board representation can be recovered from activations despite the model receiving move tokens rather than board diagrams. This is the original YouTube link supplied in the manuscript.