Why Android Fragmentation Is Still a Problem
pcmag.com
pcmag.com
You can't delete them, but you can disable them (since at least ICS) so that they only show up in the Settings -> Apps -> All listing.
A "Google stamp of approval" for devices outside of the Nexus line with similar software and hardware standards would do wonders.