Samsung made a line called Galaxy Player. The cheapest one was $150 and sported a 3.6in 480x340 pixel screen, at a time when you could get an iPod Touch for $200.
There expensive one, the Galaxy Player 5, cost more than Apple's offering.
And they all ran Android 2.3
Similarly, there was Archos. They made a whole family of Android player devices at the 2.3 era, and where infamously buggy.
Sony made the Walkman Z as a phoneless counterpart to the Xperia Z. It was $250. Supposedly a fantastic device, but that's not really undercutting Apple very well when Apple was selling iPod 4 devices for less.
I mean, Black Friday doorcrashers this year were iPod 4 at $130. I can't think of any android counterpart I'd want at that price. Maybe Motorola can figure out a phoneless Moto G with the right nudge from Google.
A big problem is also marketing - these companies are only now figuring out how to market their handheld devices in the carrier-controlled countries since up until then they just handed the devices off to carriers and maybe put up a few ads.
Meanwhile, Apples had their own stores.
Samsung could stop shoving money into ads and could start putting together coherent store-displays of their non-carrier product line. Sony should revive their store-brand too - they were Apple back when Apple made beige boxes. Sony could be Apple again - they've stopped the race to the bottom and seem to be investing in quality. I'd love to see Sony put together a coherent adversary for Apple using the Android/Win8 ecosystems. They even have the kind of market breadth and to put together a counter to the iTunes/App Store with their gaming and media holdings.