"but our writing of numbers comes from Arabic"
Not India?
Not India?
So the Persians picked them up and put them in their right-to-left text, so little-endian for them, and then Europeans picked them up from the Persians, all as-is. Little-endian would make typesetting columns of figures simpler, but that ship sailed long ago.