It's hard to get from usual companies like Lenovo, Dell, HP etc.

I just want ARM64 with ECC and the ability to put quite few NVMe inside (U2 or M2, doesn't matter that much)

I've seen those, but they cost a fortune. Even the smallest 32core CPU with 128GB RAM and a couple of nvme ssds costs more than 10k.