As a non-vegan* that has in the past greatly enjoyed calimari (and octopus), I've long felt that it presents me with an ethical dilemma because of how intelligent octopus, and to a lesser degree, squid, are. However, birds have incredibly dense brain matter compared to most other land animals, so if I start worrying too much about ethics in eating meat, I know I'd have to cut out far more than just the intelligent molluscs, and the whole thing is awkward.
Most people don't like that awkwardness, so it's not surprising that you get pushback.