In the case of Deep Blue the movement of the pieces isn't pertinent to the game - if human/robot assistants moved all pieces for both players it wouldn't alter the result [except possibly in some very edge cases].

For IBM Watson playing Jeopardy against humans the buzzer reaction time is exceedingly important. The buzzer is an integral, possibly even central, part of the game.