You hit it on the head with the latency - although it only adds second or two at max, we want to make sure that we can keep it as short as possible.
That said, we have a couple of international beta testers who seem to have a good experience, so I think that we will reevaluate this soon.