There is another way to go about it - ignoring the phone completely while enjoying biking or jogging. Or leaving it at home.
Unless I am on a call duty, all my notifications can wait.
Turns out, the number of times I pulled over to return a call or message was precisely never. There was nothing so important that I could do anything about it by the side of the road, or that couldn't wait half an hour till I got to work/home.