I live in upstate NY, where farm land is cheap (in relative terms). We are seeing an influx of Amish, who can no longer afford land in Ohio and Pennsylvania. (To be clear, they might be able to afford land, but at such a cost as to risk the enterprise and family. The Amish won't do that.)
We are also seeing new farmers moving here from states such as Wisconsin. They have family in those states, but they can't afford the startup costs including land. Here they can.
I think land costs are more complicated than you make out.