I suspect they are just pissed off with us.

I did a whale watching tour from Húsavík last year on a cranky old boat. We found one but the poor thing was asleep apparently, just surfacing every few minutes to breathe. Immediately buzzed by about 5 boats full of people every time it surfaced, two pictured here: https://imgur.com/a/g4em6sc . I think I'd be in the mood to tip a fishing boat after that every day.