There are already a bunch of mean comments in this thread. You're right that instant-dismissal and unconstructive criticism on HN is a problem.
Some people will like the shirt and buy it. Some people will not like the shirt, and will not buy and and not make any comment on it. Some people will offer some kind of critique, which is sort of fun but kind of futile (the shirt is made and being sold. It's too late for critique unless you're going to make and sell another batch in future.)
But what to do about the people who don't like the shirt and loudly tell everyone that they don't like the shirt in ways that are not interesting or useful? Do downvotes work for that?
Do you need to give a small group of carefully vetted people a super-downvote button? (This would be based on your knowledge and trust of those people, not on any karma scores). ((I've wanted to start a hoax about the HN secret pages for high karma users. I've resisted because that kind of meta drama can be pretty harmful, and there are other places where it'd be more fun.)