> You used your turn in the present, and created a new board where it's their turn in the past.

Doesn't it depend on the piece you use? Knights and Bishops seems to be able to move on the board and move back in time at the same time.