I'm not sure how common it is (in tech) to be interviewed by the person you work under. If it were common, I would agree with you.
But even that’s irrelevant because of turnover and reorgs, you’re not likely to be under your current manager for long.