If bananas reflected yellow light, but we saw them as blue instead by some purely neuropsychological phenomenon, would this cause any significant problems?
Dark blue isn't really any 'darker' in terms of energy content spectrum than orange is, its our brains that have evolved to make this association that X spectrum is dark and Y spectrum is bright.