Thermal limits. Lots of cores in a tiny space will generate lots of heat under a full workload. They can do full speed in short bursts (or when only one core is working hard) but can’t sustain full performance indefinitely without damaging themselves. The more cores in a small space, the lower the clock speed they can sustain for long periods of time.