Take the population today, and remove modern agriculture. Take the food supply down to what it would be per-acre without fertilizer. Then lower it again for lack of irrigation in many areas. That's a start.
You'll have to remove more than "modern" agriculture, considering that the world population passed 100 million over 2500 years ago [1].