It's the same problem. Assume my GPS clock is synced to actual GPS. You turn on your spoofer and now my clock sees that the GPS source is running faster or slower than it should be so it falls back to the internal oscillator.
What if I am careful not to mess up and introduce only microsecond/millisecond level corrections? :)