I work at a self-driving car company and we observed a similar problem when we did some off-road testing on dirt tracks. The cars were too precise and they were cutting deep ruts into the soil. We too solved it by adding a pseudo-random offset to the track.