You would see many more distorted galaxies if this kind of effect would contribute a lot of illusory galaxies