This is not the problem. You can find comments here how people literally said what 'it were running better than x86 Macs with 16+GBs'.
ADD: and 'nobody needs more than 8GB, because it works so fine'. Just to clarify.
Idk if it swaps fast or what, and I don't care.
M1 memory latency is 100ns, which wasn't really competitive with amd/intel at the time (70 something nano). Any SSD read be an order of magnitude slower than reading from ram - something to the tune of 5gb/s version vs 70gb/s for the SOC ram. For comparison, the intel trashcan mac pro clocked in at 60gb/sec a decade prior.
Reference:
https://www.anandtech.com/show/16252/mac-mini-apple-m1-teste...
https://www.anandtech.com/show/16214/amd-zen-3-ryzen-deep-di...
I'm basing my knowledge on discussions with other developers on rwkv.cpp because we were talking about how performance scales with the number of tokens per iteration. Memory speed/bandwidth came up and some things about M1 were said. Sorry about that.
Reading these always feels like winning an F1 race, then being gaslit about how that’s not possible because of inferior cylinder design.