> Everywhere people had the choice between what they were doing before and agriculture they either chose agriculture or they died out.

Once the agricultural revolution began, the extra food allowed the population to grow rapidly, forcing people to keep up with agriculture lifestyle to stay fed and survive - they couldn't just back out.

If anyone finds it interesting, I strongly recommend reading "Sapiens: A Brief History of Humankind" by Yuval Noah Harari - a very insightful book that also talks pretty extensively about the flaws of the agricultural revolution.