You can also click the three dots icon next to the video thumbnail of recommendations and select "Not interested"
Overall the algo is very very recency-influenced. You can watch videos from a niche interest for a year straight, but if you then spend a week watching nascar, you'll never see anything but nascar videos for months unless you say "not interested".
I imagine they have found that for the average user, having a longer history doesn't improve G's metrics.