You're running a signal at 2.4+ GHz (commonly 3 GHz for DDR5-6000) over 288 pins over several centimeters simultaneously, it's not pretty.
Is that why everyone is complaining about ddr5 prices? Atm I'm fine with my ddr4 box and will probably still be for the next few years.
Tbh the last time I've seen a noticeable difference from memory speed was when I overclocked my ram (and system bus!) from 66 to 100 Mhz. Back in the pentium 1 / amd k5 era, i believe.
I do have a feeling what you're describing only means 5 more fps in some benchmarks...
And last, a friendly reminder. If your working set doesn't fit in ram you're screwed no matter what your ram speed is :)
For example 64gb from Samsung for 350€ https://www.dateks.lv/en/cenas/atmina-ram/1028642-samsung-64...
I think they go up to 512gb per single module these days. The really big ones are really hard to buy for us mere mortals but you can get them through various data center/enterprise hardware vendors.