You hit the nail in the head with your last sentence. It is a psychological defense mechanism.

People don't want to be associated with fraud and would do any mind tricks to explain things away, while knowing the illusion is there.