Note: I follow a more standard definition of bias [https://en.wikipedia.org/wiki/Bias] which makes it errorneous nearly by definition.
Indeed. Use of priors do not intrinsically make the system biased. It's a bias only if those priors are incorrect for whatever reasons, or if the facts specifically about the sample under consideration are not able to override the population priors.