People have been talking about peak oil for decades, as long as I can remember, and it never happened.
I think we're technologically capable of extracting more oil, coal, and gas than we would ever want to. We would cook ourselves with the damage we'd do to the climate. I think that's the real constraint - and I hope we pay attention to it.
Here comes the kicker, though: we obviously extracted the easy-to-access resources first. While there may be counterexamples, looking at ore grades makes it clear that this is not particular to oil.
What happens next is that the economics of the wells are getting worse, which means we need a higher oil price for them to be viable. This also results in a lower energy return on energy invested (EROI), which reduces the surplus energy available to transform our environment. Consequently, this implies slower growth in the economy. Which I think is pretty obvious in the west and would explain the explosion of debt.
What you say about the economics getting worse and lower EROI may be true. It certainly seems like common sense. There are some counter-examples though.
The inflation adjusted cost of extracting oil from the oil sands in Alberta, Canada has actually decreased over time, not increased.
But generally I'd expect increasing cost of extraction to be the norm.