The technology is getting smaller! It's just that at the same time, people still demand orders of magnitude higher performance. There are physical limits to how small a cooler can be, and that takes up like 95% of the space.

Nobody wants a small gpu.