My problem with the built in app is the placement of important buttons. I'm constantly hitting back/play/forward instead of the "back" button when navigating artists or albums.

It's the same issue I have with the AirPlay icon on the iPhone lock screen; it is right beside the forward icon and I am ALWAYS hitting forward instead of my intended tap on AirPlay. When you're listening to a two hour podcast, this is very frustrating.