I'm having trouble imagining a society with mathematics (beyond just counting) but not writing. Are there other known examples?
Aside: Is Quipu not a writing system? I thought there was some evidence indicating it was.
But IIRC a number of writing systems started off first as mathematical record systems before developing to encode linguistic information. Maybe a good example is cuneiform, which started off as tally marks in balls of soft clay stored in jars, for tax purposes, which developed symbols for encoding what kind of goods were being counted. Quipu may be similar, with more nascent development as a linguistic system.
The Sumerian society that developed cuneiform numeration/writing was a large bureaucratic urban society built on complicated debt/taxation/social organization.