Why Amazon's data centers are in spy country (2016)
theatlantic.com
theatlantic.com
When DARPA Internet was turned over to the public, one of the largest interconnect points was at 8100 Boone Blvd (Tysons Corner), known as MAE East [1]. Once upon a time I had access to it, as did countless other people running small ISPs around the area and renting rack space in that building. But the building (it's actually three buildings, and the MAE gigabit switch [2] was in the basement across the street) was not really suitable for any kind of a data center, though above.net did manage to convert the whole level of a parking garage into one, albeit with very low ceilings.
Pretty soon everyone figured out that by Dulles airport rent is way cheaper, you can build from scratch, there is plenty of electricity and water and connectivity is cheap, and AOL was out that way too.
That's pretty much the story. Amazon barely existed then. There used to be a nice bookstore nearby called "Computer Literacy Bookshop", which eventually went all online and later got acquired by Amazon or B&N, can't remember...
[1] https://en.wikipedia.org/wiki/MAE-East [2] http://www.fairfaxunderground.com/forum/file.php?2,file=9012...
At one point blekko moved into a brand new datacenter in Santa Clara which had only limited fiber connectivity. @ChuckMcM twisted their arm for a free interconnect to MAE-WEST so that we could move over our existing inexpensive transit and interconnect contracts. Everyone's in MAE-WEST.
Today, I'm a network engineer at an ISP. Go figure.
> MAE-WEST is still at 55 South Market in San Jose, for example.
Yep, and fiber runs from there to 611 Folsom and into Room 641A.
(Edit: It probably wasn't quite that early in the Internet's life but it was still very young.)
I can't remember exactly, but it was either at the end of Westwood Center Dr or Spring Hill Rd. I don't remember when they started moving out to Ashburn/Dulles, but I know for sure they still had 3 brick buildings in Tyson's in 1997.
But I think another reason companies like it here is because of tax structure. I hear it is more advantageous for them than being in DC or Maryland.
Other fun thing, apparently if you dig around Tysons Corner you have a high chance of randomly hitting 3-letter agencies' fiber. And then black SUVs come and talk to you in a surprisingly short amount time: http://www.washingtonpost.com/wp-dyn/content/article/2009/05...
I actually had a professor who specializes in algebraic number theory quit and move to DC, saying only that he was going to "work in Washington." I guess you can't really be subtle, there's not that many jobs out there in algebraic number theory.
Q: How do you apply to work for the NSA
A: You pick up the phone, call your mother, and ask for an application.
Q: How do you get a job application for the NSA?
A: Pick up the phone and ask the dial tone.
Fort Meade is east, across the street, the Baltimore Washington Parkway, from Laurel, MD, and my wife and I lived there.
I worked at the Johns Hopkins University Applied Physics Lab (JHU/APL) in the group that did the calculations for the Navy's version of the USAF's GPS, well before the GPS. But my work was in the fast Fourier transform, power spectral estimation, etc. of passive sonar signals. Mostly I was writing PL/I code for the 360/91, 60 ns cycle time, 8 byte wide, 16 way interleaved main memory.
So, not everyone in that area worked at Fort Meade!
There's a fuck ton of them.
Lots memories skateboarding around those places, then getting chased out.
[0] https://www.google.com/maps/place/Washington+and+Old+Dominio...
If they ask for a security clearance or are willing to sponsor it, it probably has to do with that $600M private AWS instance for the CIA.
But yes if you have a clearance here you can pretty much walk out of the building if you don't like your job and walk into the next one and they'll give you one. (That's the joke anyway).
Edit: I found a map with the C2S region on it, and it does appear to be in the VA/MD area.
No, anything remotely close to the US government requires a full citizenship. I got slammed by that when I was in the middle of applications for scientific software companies which did government contracting on the side.
Some excellent naming there ;)
Also worked for the military and we had a variety of citizens, non-citizens, green card holders and non-green card holders. We had to go through silly gymnastics on who can talk about what and work on what depending on their status.
I've personally known permanent residents to work in government contracting.
For your case, if I had to guess, it's probably the physical building/facility they required you to work at had restrictions on unescorted non-citizens.
http://docs.aws.amazon.com/govcloud-us/latest/UserGuide/gett...
"§ 120.15 U.S. person. U.S. person means a person (as defined in §120.14 of this part) who is a lawful permanent resident as defined by 8 U.S.C. 1101(a)(20) or who is a protected individual as defined by 8 U.S.C. 1324b(a)(3). It also means any corporation, business association, partnership, society, trust, or any other entity, organization or group that is incorporated to do business in the United States. It also includes any governmental (federal, state or local) entity. It does not include any foreign person as defined in §120.16 of this part. "
http://pmddtc.state.gov/regulations_laws/documents/official_...
Though I'm sure AWS does lots of work with US government agencies in us-east-1, so it's not surprising that a government clearance might be required for some of it.
As for us-east-1, it all began in Chantilly in an existing low-rise building you could mistake for rentable office space, then expanded to several different sites between Sterling, Ashburn, and the airport itself, and perhaps surprisingly, to another place where famous battles were fought. Finally, they have a site a bit further away, near where Disney was going to build a theme park. That's where they want to expand more, but first they have to convince the power company to get them a dedicated line, instead of being fed from the same place as the battlefield.
Some sources:
https://aws.amazon.com/blogs/aws/new-aws-govcloud-us-region/
http://www.oregonlive.com/silicon-forest/index.ssf/2011/11/a...
http://www.oregonlive.com/silicon-forest/index.ssf/2011/10/a...
Some people operate directly with the intelligence agencies (and work on their campuses as part of their duties for AWS). These people often handle sensitive data and therefore need clearance. Amazon often hires individuals who are located near intelligence services to ease this.
There is plenty of governmental work out there that mandates certain levels of clearance. Even big consulting firms like Booz Allen or Accenture will require it for certain hires.
It's a bit of both. Network providers were encouraged to build in the area to support government requirements lead by defense and intelligence. But that same infrastructure supports commercial. When Equinix built their exchange in the D.C. area to support those customers, it snowballed from there.
It also helps that the D.C. area has cheaper electricity than many parts of the country. And a major transmission line serving the east coast runs west of D.C. Fiber + cheap electricity adds up.
It's more than just Amazon that's out here. Azure and Rackspace have datacenters out here, as well as a large smattering of colos and smaller providers.
This was for security as DC and Exchanges are CNI targets - ironically the PIRA did blow up the building next door.
Northern Virginia doesn't really have any incorporated large cities to speak of but it's just at the southern end of the Northeast Megalopolis mega-region [1] so it's quite urban in many areas. Notable "cities" might be Tysons Corner, Alexandria (a city without a county), Arlington (a county with a city), Reston, maybe a couple others. Large parts of the area are preserved as National Monuments, National Parks and Battlefields from the Civil War. However, most of it is very very suburb.
Despite the image of being , being near the seat of government it also has an amazingly diverse population. The boring suburbs are also punctuated with restaurants from almost every country you can guess, religious groups from JW to Jainism and even local theaters that will play Bollywood to Korean Horror.
And I don't mean like a few representative examples, I mean like a dozen competing large supermarkets that deal in goods for Asian customers from a dozen countries, a half dozen for Latin and Hispanic, African restaurants from around the continent, a reasonable Vietnamese-town like area, two (almost three if the third one can ever get established) Korea towns, a couple quasi Chinese areas, a dozen or so up-scale dining and shopping areas. One could easily eat a meal from a different country for every meal of the day for months and not exhaust the region.
The diversity is so intense and the population so large the area can support very niche kinds of services, for example, you can find several Indian owned coffee shops that focus on coffee and Indian desserts, or you can go eat Chinese Hotpot, then hop out for a few hours of conversation at a local hookah bar and finish your evening at a Korean spa, then wake up at 2 in the morning and go get all night Salvadorean food. The next day you stop at a Korean bakery for breakfast, work your hangover off on Ethiopian food for lunch before diving into your choice of Persian, Afghan, Lebanese, or Kazakh style kabobs for dinner. It gets kind of ridiculous and knowing how to eat with chopsticks, what to do with injera, roti and how to eat Pho, Sam Gyup Sal and that real Tacos aren't crunchy is basically expected among locals. Ndole, Silpancho or Pupusas for lunch and Thai, American Chinese, Szechuan, Beijing or Taiwanese for Dinner is not untypical. Locals feel weird in less diverse environments and don't understand why they can't eat from the world when they travel.
You get all the benefits of suburbia, but very few of the downsides (nightlife could be better). The weather is the worst form of all the seasons: hot, humid summers; cold wet winters; frequently overcast; with a few days of nice spring and a few days of nice autumn with colorful leaves. Because of the huge numbers of migrants, nobody knows how to drive in the winter, skiing sucks and Atlantic water sports are boring.
Two major airports, rail links, several ports nearby, a thriving tech industry (mostly serving the government) and a huge stable employer (the government) mean that the economy is remarkably stable in the face of massive economic up/down turns. It's hard to catch a wave up, but it's also hard to find yourself without a job, especially if you work in tech. You can drive for 30 miles in one direction on one road and see almost back-to-back-to-back tech companies. Traffic is easily #1 or #2 in the country with no predictable patterns or ways to estimate transit time, so out of towners expecting back-to-back meetings all over the area are very sad.
Bartaco (Latin) Barcelona Reston (Spanish) Our Mom Eugenia (Greek) Neyla Mediterranean Bistro (Mediterranean) Crisp and Juicy (Peruvian) Bento House (Japanese) Ariake (Japanese) Cafesano (Mediterranean) Singh Thai (Thai) Mon Ami Gabi (French) Enatye (Ethiopian) Lakeside Asia Cafe (Chinese) Cafe Montmartre (French/Vietnamese) Charcoal Kabob (Afghan) Tipicos Gloria (Salvadorian) Nomad Grill (Mediterranean) Balaji (Indian) Pupusas Express (Latin) Taste of the World (Indian/That/Filipino) Euro Bistro (German) Pho 75 (Vietnamese) Granada (Middle Eastern) Thai Luang (Thai) Russia House (Russian) Busara (Thai) Saigon Pho (Vietnamese) Turcuisine (Turkish)
and so on....add 10 more minutes and you literally triple the number of places....add in regional Chinese (Cantonese, Szechuan), end up in Sterling and you open up the Middle Eastern places, head South East into Annadale and you're in the 3rd largest Koreatown in the U.S...or go to Centreville and you're in the 4th largest.
I didn't even put the more quasi ethnic places like Italian or Bagel shops.
I think it is a stretch to say Bagels are "quasi ethnic" but more importantly the mealy doughnut shaped loaves of bread around here are not "bagels."
NoVA also suffers from the worst habits of mid-20th century civic planning, designed heavily around cars. All of the urban areas in NoVA are urban automobile areas. It wasn't until recently that dense, urban, mixed-use classic city-type areas were even being built outside of D.C. and Arlington.
>how about a museum? http://www.restonmuseum.org/
okay okay, it's about Reston's history, but Reston is smack in the middle of tons of historic sites, many of which have small museums. If you want the big museum experience there won't be one until you get to Baltimore because the entire museum "scene" (such as it is) is swallowed entirely up by the Smithsonian, the National Galleries and the smaller museums all along and near the mall. I'd probably challenge the notion that urban cores necessarily have lots of museums though. Even Manhattan doesn't have as many as D.C.
If you want art, you're more likely to get into the local gallery scene. NoVA has quite a few fine art galleries.
To give a sort of +1, I'll state that one never knows just how well they have it until they experience elsewhere. I'm a Northern VA native, but I lived in Germany for 3 years (returned last year). Germany is lovely, but came nowhere close to the cosmopolitan area I was used to. Everything bane described is true. The limited options for food was the most noticeable. If we were lucky, we could find some esoteric Asian spices for our paneer from the Feinkost downtown, but you'd pay 10EUR for a tiny glass jar. I missed the Lotte or H-Mart where I could grab a bag of the same stuff for $2.
And the diversity prepares you as well. People in Northern VA, have to, as a matter of circumstance, interact with people who may not speak the same language. (Some don't like this, I, don't mind.) Jobs are filled by people of all types. The services economy is hugely diverse, and you can quickly see all of the different facets to the economy and the issues people discuss in a few square miles.
Fairfax did toy with the idea of incorporating. Tyson's I'd agree is probably the closest we have to a city outside of D.C. Fairfax around Rt 50 and Rt 29 is pretty dense.
I visited S.F. once, and I'm envious of the atmosphere there, with the exception of the insanely high prices. (my perceptions of what constitutes reasonable rent is already distorted by my growing up here) That S.F. still keeps that vibe in the face of such prices makes me wonder how much it will last. But D.C. is gentrifying quick, and there's old sections of the city that are under threat of losing some of its diversity.
It's really hard to explain to people not from the area how embedded the ethnic diversity of the food scene in NoVA is and it really forms itself in the consciousness of the locals. It really is its own thing. For example, when I was in Portland, the locals talked up the local foodie scene quite a bit, and the food really was excellent. But the diversity was totally different, e.g. thousands of variations of a few kinds of foods -- like microbreweries. The local competition in that limited menu-space made for excellent eating, but the non-American food selection wasn't there. It wasn't until I was in NoVA with some Portlanders that they "got it", we literally ate food for lunch from a different country every day of the week for weeks before we started ranging too far.
I think the only place I've been to that is similar in "feel" is NYC, but you really have to hunt down the food in the various historic ethnic enclaves.
Here's an example [1]. Nowhere particularly interesting NoVA, a couple small neighboring strip malls like anywhere, except there's: 3 Mexican places, a Peruvian place, 2xVietnamese places, a Szechuan place, Indian food, Thai, and an Indian grocer -- all mixed in with the usual assortment of fast-food, Starbucks, autobody shops and other typical things. This isn't even a particularly "ethnic" part of NoVA.
Here's another right up the road [2]: Pakistani, Turkish, Indian next to a Dunkin' Donuts and a Subway.
Here's one strip mall [3]: Salvadorean, Guatamalan, American-Chinese, Russian, Afghan, Vietnamese, Middle Eastern grocer, and a Middle Eastern restaurant mixed in with a Panera, Italian deli, Popeyes, Subway and McDonalds.
These three places are probably within 15 minutes of each other.
When I'm in Europe, it's great eating the local food for a few days. But then I find I start craving the diversity again and it's simply never there. Even very cosmopolitan cities like London aren't quite there.
1 - https://www.google.com/maps/place/@38.9009113,-77.4508584,19...
2 - https://www.google.com/maps/@38.9775979,-77.4099158,19z
3 - https://www.google.com/maps/place/Granada+Restaurant/@38.968...
I've always wonder what would happen if us-east-1 was somehow destroyed. How much would be lost?