Good point. I tried asking ChatGPT to write the numbers from 1 to 10 in 1 sec intervals and it couldn't.
Edit: Oops, I read the question the other way around. Humans can easily emulate ChatGPT's behaviour in this scenario -- just say that, as an LLM, you cannot do the task.
Interesting, this test can be worked both ways then: ChatGPT will answer quickly and with different cadence than a human AND it will, at least for now, struggle with precision in timed events.
Agree. Anything you ask could be typed in by a human using chatgpt or google so requiring an answer quickly should be able to detect it was a bot. Could also ask a large number of questions and expect rapid responses for extra assurance.
I guess the added benefit here is you also weed out AIs that can't perform quickly.
I was thinking along these lines. I was imagining something like a "capture" that was a page of text, and to ask the AI binary questions about the text. Eg. "In the story below, what was the colour of the ball".