That doesn't at all mean that the firmware can't be exposed through the filesystem. Is that a bad idea? Almost certainly. Is it possible? Absolutely yes.
Even after a chip has firmware loaded, which controller can make logical sense of a filesystem?
According to SDXC specs, the controller looks for exFAT markers to relocate the table and bitmap to smaller AU units.