I agree that modern Android phones (mine [Sharp 200SH] has 4.1.2, dual core CPU, 1GB RAM) are pretty smooth, and seem more or less the same as modern iOS devices on that front. [Apple sometimes seems to go to extra lengths to put in little animations etc (e.g. the screen rotation), but I'd classify most of them as frills.]
... with one glaring exception: on my Android phone, at least, pressing the home button very often takes a good 1-2 seconds (sometimes more!) to take you to the home screen, with no visual feedback that it's doing anything. A second with no feedback is an eternity in GUI time. iPhones (and iPads), on the other hand, respond pretty much instantaneously to the home button.
I'm pretty used to this behavior, so I know to just wait, but it's still pretty annoying (one hits the home button quite frequently in typical usage).... Even if there's some property of the Android software that makes it challenging to do the switch itself quickly for some reason, couldn't they have at least provided a little visual feedback that it's doing something...?!