Open source is, indeed, a red herring when talking about iOS or Android. It's a buzzword more than anything. And if anyone thinks you're somehow safe because people can audit the open source version of a closed iOS app, they are delusional.
You also have the baseband CPU on many devices, which can read unencrypted memory anyway. So it is a hopeless case. Which is why this whole secure text craze HN is on is just insane. You'll never beat the momentum of iMessage or WhatsApp. But worse, there is not even any point! Trust begins and ends with a closed device.