The ESP is just a FAT-32 partition, so its capable of being up to 4GB (by default).
At 4GB you can probably store most linux distributions on the ESP, so the title makes it less impressive than it is.
I think that ESP partitions formatted as HFS+ were a thing on Intel Macs, but I've never had one to try it out.
[1] rEFInd's website lists a bunch of available file system drivers: https://www.rodsbooks.com/refind/drivers.html#selecting
There are also standalone EFI drivers that can be loaded by other means: https://archlinux.org/packages/extra/any/efifs/ (e.g. systemd-boot loads these if they are installed to `<esp>/EFI/systemd/drivers/`)
So now you're asking your users not only to bless the EFI loader, but also to resize their ESP, and most likely system partition.