The mysterious origins of punctuation
bbc.com
bbc.com
Quite interesting that punctuation co-evolved with musical notations. I had thought that punctuation existed prior to musical notation.
Side note: although American English speakers employ quite diverse pitch and meter patterns, e.g. more homogenous populations, as in many European countries, have extremely consistent spoken pitch and meter usage patterns over phrases and sentences.
I'm aware of some studies that try to determine whether or not this slows down reading, but in my own experience it doesn't get in the way much.
So at most every alphabet can have 4 forms, depending upon its position in the word: start, middle, end and standalone (but there are caveats)
Also in these languages usual punctuation marks are inverted like question mark, comma is drawn the other way round
After a while one gets used to it.
This, over-dividing problem, along with the under-dividing problem you mentioned, are both huge hurdles for machine textual understanding and machine translation systems.
On the information-extraction system I'm working on now, roughly 80% of the entities we're trying to extract are multi-word expressions. Very difficult.
[1] https://en.wikipedia.org/wiki/Multiword_expression
[2] http://aclweb.org/aclwiki/index.php?title=Multiword_Expressi...
https://en.wikipedia.org/wiki/Principle_of_compositionality
I don't have hard numbers, but I know from experience that a large share of multiword expressions are non-compositional (the meaning of the larger phrase can't be inferred from its constituents), so in that case thinking of them as "over-divided" makes sense to me.