You can remove videos from your YouTube history and then they won't influence the recommendations you get.