If you need to compare Android devices to the previous market in order to make it look consistent, it is in fact fragmented.

It's not like you need a new binary for each platform, but the screen sizes, device capabilities, and whether or not the drivers work properly differs across devices. Enough so that an app which works fine on some devices might not operate properly on a specific device or a certain manufacturer's device line.