I always assumed the word gap was because of conversation, not that high income earners were reading a dictionary aloud.
That said, are high income earners more available for conversation? Seems like a good question for economic researchers within child development.