For me, this only happens when I scroll up. That seems sensible to me.