I find that the mere presence of the phone is distracting. It's subtle and I didn't notice it until I physically started putting it in another room. I don't mindlessly pick it up and opening an app.
I set my phone on the table/desk and completely forget about it. 4hrs later I see I missed 6 messages, a few I would have prefer to respond to when they arrived.