Meat (or rather, animals) also consume a lot more resources to produce the same amount of available-nutrient output. I'm a meat-eater too, and I agree with your assessment, but it's a little disingenuous to pretend that vegetarians have no reasons for their actions.

(Also, IME there are as many reasons to be vegetarian as there are vegetarians---they all have a slightly different answer.)