I think you overestimate how skilled you need to be to work at Google. Google has famously put people through enormous hoops to work there, regardless of the complexity the engineering the new hire will work on.
Organizations like NSA also have a negative reputation, but find plenty of people to hire. They just look outside Stanford,CMU, etc.
I suspect that as the people who don't have to work there stop applying, Google will widen it's parameters to snare in the people who have to work there.
(I've met many a person at Defcon who did a stint in the intel community because they saw it as the only path to a high paying job if you don't have an elite upbringing and don't want to directly kill people.)