Maybe I'm just dumb, but surely the actual language order is entirely irrelevant? If hypothetically we wrote in English right-to-left instead, then we'd write our numbers right-to-left, and our memory dumps right-to-left, so then we'd find that little-endian caused the data to start with the smallest byte first (on the right).
Mirroring the language doesn't undo a mirroring within the language, and that's what little-endian is, so a more accurate statement would be:
>Binary dumps look more in line with how humans with single-direction scripts expect to read numbers.