That only applies between power boats. Between sailboats the direction of wind is what determines the right of way.
And of course power boats must give way to sailing vessels.
And of course power boats must give way to sailing vessels.
(Yes, I know colregs is a bit more nuanced than that, but I think this is a decent approximation)