Don't know if it's related but in one of my first classes as a kid (where we learned to count), we had some sort of banner on the wall that listed the number from 0 to 100. Maybe picked it up there.. Sometimes I also think this makes the more abstract math concepts harder for me to understand. If I can't visualize it, it won't stick (easily).
Asked some friends how they saw numbers, and they don't have anything like that. Wondering how this is for other people.