(The easiest way to cause worldwide financial panic is to bring a GPS spoofer near NY4. Most of HFT operations synchronize time via GPS receivers).
The other reason this is unlikely to be a problem is that network time protocols break all the time (oops someone did a maintenance and broke sync with the master clock). Lots of real world trading code has sanity checks on the time.