Anandtech measured the ram latency at >90ns, which is not great:
https://www.anandtech.com/show/16252/mac-mini-apple-m1-teste...
The cache on the M1 is also massive. If Intel/AMD have clever prefetchers to make up for this, it looks like the M1 might be doing something more.