Yes but how much of this problem is a spatial limit and how much is a product of other physical limitations?

You might be able to reduce critical paths using memristors and 3d circuits but I imagine there are other fundamental issues.