The problem with this is remembering what you want to play, for pieces of any length and complexity. The comparison in that case is not talking, but reciting a long poem/article/novel.
I'm personally envious of those who can play by ear but have found reading music to be easier to learn by comparison and more precise.