"$" is a modifier, not a word. Otherwise you'd be reading it as "9 dollar sign", not "9 dollars".
Calling it a "modifier" implies that it's something more than a convention. Currency symbols are formatted differently in different countries, according to custom.