Some Stable Diffusion repos are already using an additional specialized model that fixes faces.