We have been using the resources we need. A bunch of rock and magma isn't really useful to us. It's things like soil which only exists on the surface, or oil, which has been getting harder and harder to extract.
> or oil, which has been getting harder and harder to extract.
Harder to extract but still in much larger abundance than what was predicted by mostly everyone back in the 70-80s. I don't know if you were around then, but you may have heard of "peak oil". It never happened (as in, not yet, and that was already a long time ago).