The rate of change is what matters here. We are causing the climate to change at a
staggering rate. Faster than anything ever seen in nature except during cataclysmic events (massive volcanic eruptions, meteor impacts, etc).
The biosphere will not be able to keep up with these changes and we already know that we are causing a mass extinction event and destabilization of the biosphere. Our food system depends on the biosphere.
Our society also depends on the conditions that have been relatively stable for the last several millennia. Sure, there was a mini ice age, but we're talking about a smaller change in climate and far more gradual in that ice age, than what we are currently experiencing and causing. And that mini ice age was enough to cause mass disruption to human societies in areas most impacted by it.
Our current human caused climate change - if allowed to continue unabated - is likely to cause disruption on scales that lead to the death of billions of humans and the likely collapse of societies. We cannot ignore the cause of it (us) and simply adapt to the new reality. The way we adapt to this is by changing the behaviors that created it in the first place: We stop burning fossil fuels. That way it stops getting worse, then we work to return the climate to what it was previously, or we work to adapt to our new (now, hopefully, stabilized) reality.
We're quickly losing the window to even do that, however, because we're triggering feedback mechanisms that make this change self-replicating. So we likely need to go heavily into carbon removal and fast as well.