As for the effects of climate change, they look intimidating as a whole - when you look at each item individually, they are unpleasant but manageable. Humans have been dealing with the weather for millennia, after all.
> Stronger storms, drought
These happen routinely now. Yes, it would be preferable to have less storms and drought, but we know how to handle them.
> the displacement of peoples
In the last decade the Chinese have built scores of new cities across the third world - it's not that hard for people to move.
> an ensuing refugee crisis as their crops fail and water supplies dwindle
We grow crops in many different climates now. Crop failures happen now in poor countries with bad infrastructure and management. Societies with sufficient capital and technology can adapt to almost any climate. (In extreme climates, with desalination plants and hydroponics - or people could just move).
> Maintaining the civilisation we built at the cost of the natural world we inherited isn't fantastic
This is really the crux of the issue - should the standard of value be maximising human flourishing, or minimising human impact?