California's seemingly ideal growing conditions are only ideal when imported irrigation water is cheap and plentiful. There's whole swathes of the east and midwest that have been abandoned to cheap cash crop farming that could be growing nuts, market vegetables, fruits, etc. without the same water fears.
Consumers would simply have to get used to different varieties -- more cold hardy and fungal resistant varieties of stone fruits and grapes, hazelnuts instead of almonds, etc.