I was at Google in 2007, here's my take on it.
The people that are working there aren't just the most brilliant in the world, they literally invented a good portion of the internet, computers, computer science, and programming as we know it. They have "the father of the internet" (Vint Cerf), the creator of Vim (Moolenaar), the creator of Python (Guido), the lead developer of Firefox (Goodger), several of the lead Linux kernel developers, the creator of memcahced (Fitzpatrick), Ken Thompson and Rob Pike (both notable for several things), and hundreds of other developers that have already proven their worth (Peter Norvig and Jeff Dean come to mind).
These aren't just smart people, they're smart people who have changed the world.
To put it into context, one day I'm sitting in a meeting and someone says "Mike is working on an algorithm for that." Another person asks, "Burrows?", to which the first person says "Yea." They were talking about Mike Burrows, as in the guy who created the Burrows-Wheeler Transform (among other things). Names of people that have had major impacts like this are routinely brought in casual conversation. It's like working in a programming mecca. The crazy thing is, even the names you wouldn't recognize have most likely had substantial impacts as well.
As for critical mass, Google has it. I was standing in a hallway one day reading stats about search traffic on one of the walls (the wall slightly beyond Larry and Sergey's office, for those who have been there), and sure enough Larry, Steve Jobs, and some other guys walk on right by me. When you're big enough to have people like Steve Jobs walking around your halls... some doors open up that simply aren't open to most start ups and companies.
The thing is though that the company is really laid back. I was eating lunch one day with my team and there was an open seat. Sergey Brin came over and asked if he could eat with us. Another time it happened during TGIF, and we just sat around and drank beers. At a different TGIF I drank beers with Alex Martelli and we talked about some of the Python books he's written and how he got into hacking on Python. TGIF, in case you didn't know, is a weekly meeting that the entire company has. Every Friday the company gets together, Larry and Sergey get up and talk about what Google has done during the past week and then the floor opens up for Googlers to criticize the company, recommend things they can do better, or show appreciation for things well done. Read that again... Every week the company gets together as a whole and does a self-analysis. Any issues that are brought up will be resolved by the next Friday. When Google does something stupid, it's addressed and fixed in under a week. Most companies have a meeting once a year, and there is no self-analysis going on. After the self-analysis is done, Google has beer, food, and often live music. The company just kicks back, relaxes, and bullshits over beer. They do this every week.
As for people that haven't yet made a name for themselves... Google will give you the opportunity to. I was there for two weeks before I was running distributed programs across thousands of machines (prior to being there I had never even done serious multi-threaded programming, yet alone distributed computing). I had a copy of the Internet on one of our teams shares that I would run tests and experiments against. Yea, you read that right, a copy of the Internet (text-only). You are effectively given unlimited resources to do whatever you want. Money is never an issue, only brain power is ever in short supply. You'll never be given hard deadlines, you'll never even really be told what to work on... everything is more of a suggestion. You can find a bug, fix it, and push it live in under 4 hours (I've seen this done) and no one will stop you. If you ever get bored and want to join a different team... your desk and items will be moved to that team within 24 hours (assuming that team can take you on). Engineers are viewed as stem cells... if everyone is brilliant than anyone can learn to fill any role, and they do.
The teams bond really well. No one eats lunch alone, you always eat with your team. All the food is free, so you don't have people packing lunches, and all the food is delicious, so you don't have people leaving campus for lunch. Whenever there was a big blockbuster movie(like Transformers when I was there), Google would buy out the local theaters on opening day and take the company to see them. They made sure that you were having fun, and they made sure that you had time to interact with your team in non-professional settings.
Also, everyone in the company is at your disposal to help. The organization is nearly flat, but it doesn't matter... you'll never see someone say "I'm the Director of Blah", everyone always just uses the title "Software Engineer". It's quite a sensation. I haven't even begun to scratch the surface of what it's like working there. It is truly quite difficult to explain to someone who's never been there.
All that said, it's not perfect and there are lots of sore spots (especially as they keep growing). I won't get into them though simply because this is already long winded enough.