Same here. If they were really cunning, they could fabricate their own signal with a different timestamp. You could shut down rivals by making their computers believe that the trading day was over, or that their market feed was too slow to trust...
For deep alpha signals, a millisecond is pretty negligible (especially when you are calculating minute or 10 minute bars).
For microstructure trading strategies, since the timing doesn't manipulate the book (which is where most microstructure trades derive alpha from), the effect is similarly negligible.
And for cross-exchange and cross-asset arbitrage, where microseconds may seem matter (regnms), slight drifts are permissible insofar as you can plausibly argue that even if the clock is slightly off, your view of the market is internally consistent