The point of E2EE messengers is to prevent casual mass surveillance and to increase the cost & risk of mass and targeted surveillance. It's about increasing the noise floor of the internet and making everyone more safe as a result. It forces adversaries to use more legal mechanisms to improve your rights. It's about making you expensive to attack, much like afghanistan won the wars against the USSR and the USA by being expensive as fuck to attack while cheap to attack on their side. They're not about secure endpoints, which is a separate issue that can be worked on in parallel.
So yes, you should make sure if your threat model cost benefit says you should:
* You have a secure keyboard mechanism. No third party keyboard apps, used a wired / built in keyboard.
* You use a secure OS and keep up to date. You verify updates are public and not made 'just for you', you turn off auto updates.
* You watch the network behavior of your devices with external proxy devices to see if anything weird is happening, you filter out network interactions you don't like, use a VPN with the proxy device and so on.
The more you use 0days, the more they get noticed and the more likely you are to burn them, so you've just increased the stakes towards surveilling you. Now the minimum standard to make you a person of interest has increased significantly, reducing the probability of it.