You can remove videos from your watch history and in my experience that does have an impact on the recommendations as it's not factored in anymore