I'd just like to point out that there are considerations other than latency that you should be thinking about. Sure, you can optimize for latency, but just wait and see what happens when you get hit with a DDOS attack...
Would something like Anycast allow them to failover faster? I would imagine route propagation isn't instantaneous either, so I'm curious how big the difference would be.