I wonder if limiting APM would be a simple way to make the AI's play more "human" and less exploit-y.
So if we watch a match and see things that no human could physically do, we will know that the machine didn't win because of intelligence.
It would still be great, it just would be a simplification of the problem.