There's a features page on their website that shows some more tricks it can do, like smarter file type colouring, generating a tree view and showing the git status of files.
I'm still not entirely convinced that it's a must-have, but it's more than just ls with fancy colours.
Personally, I'd much rather have seen an output format like JSON as a feature instead, so you can do some easier scripting through exa and jq. I'm sure there are other tools out there to serve thst purpose, though.