Heh that’s overstated. As a non Asian foreigner*, you get a lot of leeway for making mistakes when speaking Japanese, as it is somehow ingrained in the subconscious here that Japanese is very special and very complicated and a foreigner trying to speak it is already doing something near impossible.

If your Japanese is near flawless except for the honorific register that would strike people as weird, but then what did you do to end up speaking flawless Japanese without ever properly internalizing honorific Japanese?

*(If you are an Asian foreigner, you are subject to many other layers of prejudice unrelated to your language ability)