There should be a clickable "unvote" above the comment if you wish to do so.

Regarding anything else about how Hacker News works, I found this quite useful:

https://github.com/minimaxir/hacker-news-undocumented/blob/m...