It's a common thought but from what I can tell it's probably not true. Natural gas is simply the cheapest and most scaled way of producing ammonia (which is the critical ingredient in fertilizer production). Apparently electrolysis could come within a factor of 2 in terms of price.
Also worth considering that passenger aviation is on the same order of magnitude in terms of CO2 emissions. Remarkable given everyone has to eat.