Use a Windows Phone.
It's almost everything that you are looking for, except for the physical keyboard. The Lumia line has some pretty good phones and you get all the basics of a modern smartphone (good cameras, email, browser, GPS, etc.) but the app store doesn't have a lot of apps to distract you.