There are words for numbers in Latin. From Wiktionary (https://en.wiktionary.org/wiki/Appendix:Latin_cardinal_numer...): unus, duo, tres, quattuor, quinque, sex...
Just like an English speaker sees "1, 2, 3, 4, 5, 6" and pronounces "one, two, three, four, five, six". Sure, the Roman numerals look like letters, but that doesn't mean you pronounce them that way.