The problem isn't us running out of nitrogen, the problem is the impact that nitrogen deposition has on terrestrial and aquatic ecosystems.
The US for example has seen a significant reduction in runoff without that much pushback from farmers. That said, there is a point where with wasted fertilizer costs less than the methods of avoiding runoff, which changes the dynamics.