Complaining about downvoting is explicitly against the guidelines:

https://news.ycombinator.com/newsguidelines.html

I'm surprised it's not explicit in the guidelines but HN has a strong tradition of staying on topic compared to some other message boards. It wasn't me who downvoted but while it's perfectly in line for you to notice your town, it doesn't add anything to the topic for you to point it out.

You're likely being downvoted simply because the comment adds nothing to the discussion. Up/down votes (points) help the most relevant and useful comments rise to the top of the page so users down't need to scroll through to find useful content.

Well I didn't downbote you. But I imagine the people/person who downvoted felt your comment was too trivial and/or insubstantial.

HN is more serious and restrained than most social media sites (like Reddit). You can reply with a joke and/or use crude language (generally) so long as you offer ideas that add to the conversation.