I tried the Nokia 225 4G. Unfortunately, it saves the SMS and MMS to the SIM card, not internal storage, so you quickly run out of storage for SMS/MMS, and you'll need to constantly delete SMS.

So I switched to the Punkt MP02. It has a lot of other problems, though, but at least those are more passable.

I did also try the Mudita Pure. But it froze on the second day I had it, so I switched back. Edit: My plan is to give the Mudita Pure a fair shot in the future.

I'm generally disappointed in the phone market, smartphone and dumb phone. Maybe I should abandon it entirely and get a landline.