Is it just me or do I have the feeling that we have gone too far with our memory requirements? Why everyone now suddenly need 32Gb, 64Gb or hundreds of additional Gb of RAM?

Same thing with GPUs, is kind of insane having so much processing power and yet requiring more and more. What purpose for? What's the limit? Does it really really pay off such investments?

For me as a non-AI developer (I don't use any models of any kind, nor I train LLMs at all), a system with 16Gb seems to be more than enough for a vast number of applications.