Any references for where you've heard this? Then we can check the claims and perhaps reassure you or suggest workarounds. What are you using instead?

IMAP is on its own insecure because it is a plain protocol, but it can be used in conjunction with TLS to add secure transport. Exactly the same can be said for many other mail protocols such as POP3.