What if you label standing still as 0 mph and start moving 10 mph, gaining x energy, then call that zero and start moving 10 mph from there? It's just as intuitive to say that you would gain x energy in that case, but you don't.
As a Gedankenexperiment:
If you are on a train that moves 10 mph and you toss a ball to give it another 10 mph of velocity (relative to the train), your arms need to perform the same amount of work on the moving train as on a stationary train.