Using your line of reasoning, meat eaters are responsible for even more animal deaths, i.e. collateral deaths from current plant farming methods plus the killing of farm animals for your consumption.
This line of reasoning seems to be an easy cop out, i.e. I won't be able to go 100% vegan, so why try.
Imagine if people would reduce their meat & dairy consumption by 50%, 80% - it would make a huge difference to our biosphere.
And then gradually reduce it to almost 0%.
It's the future ;) https://www.youtube.com/watch?v=sS7NRtEJBcA
I suggest that because farming plants also involves killing animals (using poison or mechanical means) and it is unreasonable to believe that someone who fails your ethical standard when raising animals for sale will take more care about rats/birds/… when raising plants for sale.
More generally, you'll always be able to whatabout vegans, because to live is to kill --- it's completely impossible to live in modern society and not harm something somehow. I feel that I'm obligated to do the best I can under the circumstances.
[0] https://www.surgeactivism.org/articles/debunked-do-vegans-ki...
My standards for how to treat animals don't depend on whether I eat that animal after it's died. "Can maltreat as long as I don't eat it" is IMO difficult to justify.
You'll note the wiggle room. It's not about being perfect and never contributing to animal harm because that's impossible. It's about doing the best you can in a bad situation.