Because then 'least' is on the left, and you work from left to right, in the same way that you read from left to right.
Over time we all realised that big-endian systems (IBM, 68k, etc, and our native western languages) were a hack and we've moved to little endian systems (intel, arm, DEC, ...) as sane