We’ve already extracted just about all of the “easy” energy reserves, in terms of oil and coal. Now, you need major machinery to access it. That means, a future society that is rebuilding itself wouldn’t have energy be able to advance far enough for it to matter.
Based on our current extractions of resources, we’re in too deep and no future society will be able to have an Industrial Revolution again for millions of years, if we fail completely. And by then, the radioactive waste doesn’t matter.