I think left-to-right works in this case because my target audience is the everyman, not only technical or highly-educated folks. In my experience, people care mostly about the meaning of the information and don't care much about graphs or data in themselves. In that sense, I think of this kind of graph as more of a word or a sentence than a traditional graph, and mostly we read words left-to-right.