Computing power: A deeper law than Moore's?
economist.com
economist.com
Neither Moore's or Koomey's "Law" are very deep and don't really rise to the level of a true physical law. Its been known for a long time that Moore's "Law" was going to eventually run into the real laws of physics and that seems to be happening now.
I have been hearing people say this for a very long time, but I've never seen good evidence that it was true. I mean, at any point in time, the state of the art has "run into the laws of physics" - that's why it's the state of the art. At any given moment, the best we can do is limited by some physical property. Processors don't get faster because Intel just decides to turn the clock speed up. They get faster because researchers find ways around the old physical limitations.
And I think that's the fundamental misunderstanding people have about Moore's law and similar consistent growth trends. People see a consistent curve and they think "Oh, this is just the natural course of progress, and so it shall always be." But that's not how it works. The reality is that each point on that curve is the result of team of very smart people making a breakthrough.
One of the real issues has been the cost of fab over time increasing to the point where only few are able to keep up with the current processes by it's self. TSMC will be investing 9.3 billion dollars in its Fab15, and again Intel is still fine but the ever increasing capital costs have keep narrowing the field. And, soon it's going to be 50 billion just to stay in the game.
I bought an i7 920 (2.7ghz) in late 2008.
Now 4 years own and speeds have crept up to about 3.4ghz.
For the last few years AMD and Intel have just been side-grading by slapping more cores on, instead of actually making faster chips.
I think Kurtzweil has suggested going into 3D for CPU design with multiple layers of circuits, but I have seen no serious attempts to realize this so it is a bit of a long shot to depend on to keep the pace of growth intact. However, it still does not resolve the fundamental limitation of Moores law, it only extends it for some time.
My view is not meant to disparage the work of the people who keep the progress going. My point is that at some point Moore's "Law" has to breakdown since nothing real can double forever but perhaps you don't find philosophical/metaphysical arguments compelling.
As way of analogy, look at electric power generation based on a heat engine cycle. Ultimately you run into theoretical limits based on the Second Law of thermodynamics. On top of these physical constraints are Economic Law such as marginal utility which determine if it is really economically efficient to spend x dollars to gain y increase in efficiency or to stop short of the theoretical limit due to diminishing returns on investment in efficiency gains. These are real laws that computer chips will eventually run into.
My understanding of computer chips is that they are running into thermal limits and also bumping into quantum tunneling effects that are interfering with the deterministic nature of logic gates. I am sure people are working on ways around these limits and they may very well may find new and brilliant ways to continue the increase in processing power. It may even be true that theoretical limits to computation are far far away from where we are now and Moore's "Law" will continue to apply for decades but it still would not make it a actual physical law in the proper sense of the term.
Incidentally, if Moore's law were to continue and it were as simple as "speed per mass doubles every 18 months", it would still take somewhere on the order of 300 years for us to approach Bremmermann's limit.
Very cool.