We release it because it allows us to produce energy (burn something). To remove it from atmosphere would require to put it some higher energy state so that we can store it and that require again some source of energy. Pumping pure CO2 in some mine will probably not do the job.

In reality, we will try to just reduce temperature without removing CO2, but CO2 causes problems other than tempterature rise. See ocean acidification.

There seems to not be any good solution really.