Perhaps so, but humans are reproducing later and having fewer offspring, so there are more variables than just energy.
Environmental stresses are well-known to cause reproduction rates to plummet. That can be because of a lack of available food, but it can really be any sort of stress.