The replacements for some of those poisons (large amounts of artificial fertilisers) are animal products. In a world without artificial fertiliser you need to have animals to produce fertiliser.

The optimal for this would still be much less animal farming, and a massive shift in how and where it is done. But removing all animal products would be counter productive. (Perhaps this is what you meant by plant based though).