Sure, better be safe and use a safe comparison method and that's simple enough, but still, how realistic is such an attack over the public internet?
I'm aware of "practical" results: http://crypto.stanford.edu/~dabo/papers/ssl-timing.pdf
But the experiment setup was on a LAN, with AFAICT a single server, no other traffic to that server, and other such conditions.