I think it's obvious: human beings are omnivores, and an all-plant diet involves a constant struggle against our physical desires. I don't actually think that's necessarily a bad thing if conducted for the correct reasons, but I also find it unsurprising that so few undertake it.
What I do find surprising is that so few people hunt. Hunting is something else which is in our nature, and it's fun.