We've gotten this far because we've had a rather stable climate for the past few thousand years. The current rate of the change is the problem.
You must have missed it: https://xkcd.com/1732/
You must have missed it: https://xkcd.com/1732/
A 1C rise means hotter hots, colder colds, stronger storms and longer or more frequent droughts as well as the general climate of a region possibly changing.
Yes you can find crops that will grow in specific conditions, but you need to know those conditions and if you have a day that kills a crop that can mean you need to wait for the next season. That 1C rise corresponds with a lot more of these crop damaging events as well as changing the efficiency and possibly infrastructure needed in an area.
I'll also note that the last 1C rise is over a generation not a lifetime i.e. 25 years not 80.