Probably way faster than that. 3000 fps on a standard 2024 CPU without a GPU wouldn't shock me. (If optimized for AVX2/AVX-512.)

But this is running on a low end FPGA. No ultra-wide vector FP units, no massive SRAM caches, etc.

Ok, you try building a better one then.