This is what's held me back as well, but I recently discovered the Minimal phone which is an android phone with all the things you mentioned, but with a less distracting e-ink display.
(I'm not affiliated with minimal company in any way, nor have I actually tried the phone)