If GM seeds are so horrible for farming business, our cost of living should skyrocket. Farms which don't use GM seeds should benefit. Plus, the farmers should simply pass the price hike to consumers.

The only way this makes sense to me is either GM seeds are subsidized, or a significant % of farms switched all at once.