The problem is not encryption, S/MIME works well enough for that.
The problem is you don't have public keys for people you send to.
And there's not a reason for many to get the keys.
I wish I could say "I'll read your unencrypted email tomorrow" (and delay it from getting to my inbox).