It's not just you. Mozilla ran a study recently and found user content controls on YouTube such as the 'Like' and 'Dislike' buttons are largely useless and have no effect on what we're recommended.

https://foundation.mozilla.org/en/research/library/user-cont...