In many biomes, there were large herbivores living since ever. They are part of ecosystem and and if you remove them the biodiversity actually declines. Responsible grazing is not a problem at all.
What is a problem: unsustainable farming of grain/wheat to use as feed (or even feeding processed dead animals). Lumping these together is a harmful simplification.