Xeon is a group of products with really varying specs. There is no indication of which XEONs. Also new consumer CPUs often have really small internal caches.
An Apple M4 chip in a Mac mini has 16MB on the P-cores and 4MB on the E-cores.
Depending on use case, AMD 3D V-cache at almost 100MB could also work out quite well.
So really, if you wait long enough, consumer chips end up with a pretty similar amount of cache.