For the price, you get massively more CPU power, 3x the number of easily connectable NVMe devices, at higher bandwidth each, 22x (!) the network bandwidth, and the ability to connect a real multi-lane PCIe card of your choice.
I still find it sad that NVMe is an afterthought in the Raspberry Pi ecosystem. SD is convenient, but it’s also slooooow, and it holds back a lot of raspberry pi use cases. The new-to-RPi5 official NVMe support still seems really awkward in the way it interferes with the overall thermal performance and the way it interferes with the IO header if you use the official board.