Interesting question, is it better to mine it now and store it, or tear down the industry and rebuild it if we come to need it again in the future?
I once read an article explaining that storing oil is definitely not easy. IIRC, it was super toxic, abrasive, could easily be set on fire, and of course, super valuable => you need almost a bunker to store it...
Oil is already a boom/bust business. Leaving oil and in the geological formations where it sits is probably the best way to store it.
I think Tim Flannery (though probably not the first or only one to) proposed the benefits of retaining a huge volume or oil & coal in case we ever need to thoughtfully kick-start a greenhouse effect.
There are more potent and shorter term greenhouse gases we could produce for that purpose.