"Insects die for carrots," is a problem for vegans who base their preference on the idea that killing any animal is wrong for sustenance. A person willing to kill a cow because they like the way the flesh tastes or finds it more nourishing simply isn't going to see a problem with an insect dying for a carrot. One person is holding themself to a higher standard and therefore is vulnerable to this critique. Animals need to die so that we may live, people quibble about where the line should be drawn but the line exists for almost everyone (excluding the Jain vegetarians, but practically speaking it exists for everyone).
I am not so much conflating those two as arguing that a) anti-specism much like freedom of speech has all kinds of caveats built in and isn't absolute even in the few people that would preach it, b) anti-specism doesn't form a basis for ethics because there are more absolute truths that override it but also render it unnecessary.