You will not have agriculture then. It'll be like not having any industry, only much worse.
If you're referring to agriculture disappearing from the US, that definitely wouldn't happen either. Some of it might, but not the majority. Most countries don't heavily subsidize farming to the extent that we do, and transportation costs are non-trivial, especially for fresh produce or anything that needs freezing.
https://en.wikipedia.org/wiki/Agriculture_in_New_Zealand
Edit: The thing I found most interesting about this is agriculture was deregulated by the left wing government in what is a very socialist leaning country. Kiwi's are very pragmatic.