It's an idiom. Of course, you can legitimately compare apples to oranges. I, for one, love apples but hate oranges, and I might be able to articulate why if I set myself to it.
Apples/Oranges are multi-object structured (single utf glyphs not withstanding)
?? Different base monoids, nurture [ego] / nature. But still depends on what hungry for. ??