The new way to land a job at Facebook
kaggle.com
kaggle.com
Using some startups api aside (spirit of the competition and all that), anyone interested in completing this should pick up the Springer book Recommender Systems Handbook, it's a very good place to start.
Depending on the size of the Facebook dataset, you will need either a graph library like networkx or a graph database (there are many).
You should probably use python because, let's face it, nothing else will have as many opensource libraries, be as fast, and as accessible from C as python is (use cython for painless compiled code and to link to other C libraries).
Don't use recursion unless your language is specifically built for it. Stay away from ILP graph traversal unless you really know what you are doing.
If you are using some sort of context token/vector similarity approach, be sure to know that the number of tokens you are going to need will be huge, and furthermore you will likely need some hard coded rule sets for low follower/following users.
Try to introduce a time-based decay factor or something similar, and of course take advantage of degrees of "closeness" if there are repeated interactions between nodes.
One last thing: if your approach uses some sort of map reduce solution, it might be better for real world applications, but it will significantly slow down your progress. Just load a box up with RAM and use fast algorithms.
Best of luck to all you out there!
People who know anything about machine learning will follow conventional wisdom and potentially miss out on a step change in quality of results.
Unlike, say, selling something online, machine learning has strong underpinnings in mathematics. You do really need to stand on the shoulders of giants in order to move the needle forward. It is more in common with building a bridge than it is with coming up with something revolutionary like renting dvds through the mail instead of a brick and mortar store.
Imagine a bridge building contest where the goal was to something that could take a train across a river. I should hope someone coming along and suggesting the rough concepts to an aspiring bridge builder would be lauded. "If you use suspension, be sure to check for systemic wind loads" "Don't forget about the foundations at the end of the bridge" and "If you use concrete, remember to give the concrete enough cover over the reinforcing steel bars so that it doesn't become unsightly" are all good pieces of advice that someone should know.
Now, once you learn the basics and can do what has already been done - absolutely push the field forward.
Edit: I mean; so interesting that you want to jump through hoops to get in.
If you're a so-so coder then, hey, big company, steady paycheck! What's not to like?
http://www.serversidemagazine.com/news/10-questions-with-fac...
Edit: On the other hand, I doubt he had to jump through any hoops to land a job at facebook.
But yes that makes sense; my, maybe cynical, outlook is that most people will not actually do that work there. Most will do their stinking best to end up working on some (seemingly) insignificant stuff. I read some newsgroup post from a Windows (person on the actual MS Windows team, not someone who devs Windows apps) developer once who said something like 'I WISH I had programmed the clock in Windows, at least then I could show my parents I do something remotely interesting'. For Andrei and many others it is obvious, but for a lot more people it is completely weird why they do the things they do. And I love to read their stories.
I can rant on forever about a guy I met on a summer job at a supermarket distribution hub (yeah; in the 80s as a 15 year old programmer you couldn't get on freelancer and do something cool); he worked there for 20 years and he was very happy. Because of him, people could get their food every day and he felt valuable and lucky to have landed that job. It was a great example and I like hearing stories WHY people like their job, but not only from people we all know (and love or hate).
Bottom line, the Facebook interview is not easy, and we're determined to not make it easier even though we're hiring intensively. The upside is that you get to work almost exclusively with very bright people, which makes for a very palpable difference from the typical corporate experience.
I have worked for over 10 years at Microsoft Research before on large-scale problems, for example, the TrueSkill ranking and matchmaking system used in Xbox Live and the Halo series as well as ranking systems in Bing. I can honestly say that the current projects I am working on are professionally the hardest I worked on so far and it is amazing how much gets done by a very small team of some of the brightest and most talented people in the industry.
I echo Andrei's comments that the interviews were very difficult. I got no specific C++ or PHP question but more general questions to translate algorithms into working code (being able to pick any language). This IS very important when you work here and everyone at Facebook carries a lot of responsibility so having a high bar is the right decision.
Really, yours was a serious question? And by "jumping through hoops" you mean "programming...something you (should) love to do"? Sheesh.
I work on the HipHop virtual machine, a dynamic compiler and runtime for the PHP language. It is the hardest challenge I've tackled professionally, and the people I'm working with are brilliant and work like animals.*
I think the larger significance of our work on HipHop is in the context of software as a whole. PHP is one of those "developer productivity languages," like Python, JavaScript, LUA, etc. And, though I was skeptical before I came here, developers really are more productive in these languages. It would blow your mind what world-class people working in this medium can accomplish in compressed timeframes. This means that increasing these languages' performance is incredibly leveraged; to the extent we're successful at making PHP faster, we change the set of problems that PHP can address. Moving a problem from the "must be solved in C++" category to the "can be solved in PHP" category frees up our fellow developers to get more done with their finite professional lives.
*Edit: By "like animals", I mean, "with a survival-level sense of urgency." It doesn't necessarily mean long hours.
I like your work definitely. Guess a lot of engineers would; I'm curious to know how much significant work you'll be doing if you apply now (jump through the hoops), get in and want to work on HipHop (as recent graduate). What are your options within Facebook; how far can you grow?
Reading between the lines of your posts, I think you might have a pretty inaccurate view of facebook, as it currently is. Facebook has fewer engineers than you think, and it's -really- easy to have massive impact on features, or even the org as a whole, from day 1. Most of the teams responsible for major features/products are quite small. Some are frighteningly small. In many places, there are huge, ambitious, crazy ideas currently on the shelf waiting for 2-3 new people to join the team to take on.
This is good because?
Working pass the normal cut-off is a lose-lose proposition for anyone that puts in honest levels of work during the day. You burn yourself out, diminish your capacity, make mistakes, and most of the time don't even realize it. This can go on for years, sometimes even decades.
Most of the referenced-here "passionate" behavior is probably a combination of unhealthy focus (the obsessive type or the type you use to forget about your issues), self-image, having-to-prove-something, and outside-pressure (expectations for you, matching your co-workers, etc).
The better option is to work intelligently and maintain a healthy amount of self-awareness at all times. Then leave it, shut-off, or go enjoy something that matters.
You'll produce 200% the results of your "passionate" co-workers.
My info is anecdotal from my wife, who has spent a significant portion of her life working with bears. But from the zoo keepers I've met, that mammal breakdown is true for most of the felines and primates as well.
Others: they ave 2+ kids, have been through many IPO/M&A debacles and may have gone through ridiculous divorces, major swings in their marketability or simply been screwed over by certain companies...
They hype around making tons of money can be subdued by the realities of life in between these relatively rare miollionairing events.
Thus, qualities of work other than "working myself to the bone because this company will be the next google IPO" become a big factor. This is why HP, Yahoo, MS, and others continue to attact talent - although it might represent an aging trend.
There will always be more wily generations in the tech industry. Learn, earn and avoid smugness.
I haven't learned PHP yet (and I'm only in college), but I've heard bad things about its design, and it seems to be overshadowed by Ruby and Python in my programming news sources.
Is PHP a dying language? Even if it is, it makes sense for Facebook to continue using it instead of throwing out all their code.
But it seems like it might be a waste to spend time at Facebook using PHP if the rest of the tech and start-up world has moved on.
You seriously don't have the correct mindset about this. You are thinking in a way that a lot of other people share, but it's not practical. In the real world you have to learn new technologies and languages consistently. Every day something new comes out or gets improved that makes doing a difficult task easier, and people/companies that can adapt and not be left behind do well.
If I were in your position (which I guess I kind of am, I'm also college-age but I've spent just under half my life doing some level of professional programming) I would be learning EVERYTHING I can or at least everything mainstream I can so that if I come by a cool piece of code online or at work I can tell exactly what it does.
It's true that PHP isn't as a strictly written language as some of the other languages (by this I don't mean syntax, I mean that doing two analogous operations have completely different names/attribute orders in the standard library) but it's still used by tons and tons of people. PHP isn't dying. I hate the term "dying language" because there's always something else out there that's good for that each specific language.
I'm assuming that Flash is also "dying" in your POV but just today I had to whip up a quick SWF to allow copying something to a user's clipboard because it was the simplest and quickest way to allow one-click clipboard access that I could think of and I have spent time learning Flash/AS in the past so I had that knowledge.
Now, when you say:
it seems like it might be a waste to spend time at Facebook using PHP if the rest of the tech and start-up world has moved on
I have no idea what you mean. Do you mean that Facebook not restructuring their entire codebase to a cooler and more popular language is a waste of Facebook engineers time? Or do you mean that you learning PHP to work at Facebook would be a waste of your time? I don't understand how either of these two statement could be argued so if you meant something else I'd love a clarification.There is absolutely nothing that Facebook can not do with PHP that they could do with Python or Ruby. Any business logic can be written in a myriad of ways. And I believe to be a strong candidate for a "wow" employee after you graduate you should be able to drop head first into any codebase and at the very least quickly get a simple grasp of what's going on.
If Facebook gave you an internship today would you reject it because you've heard bad things about PHP?
Sorry about the rant, but I've spent a lot of time working to hire other developers and it really irks me when I hear something like "oh so and so's a dying language, it's useless to learn it" because it shows that you don't have the drive and love of technology that my ideal person would.
But I'm doubtful of its real-world application these days. Most news I see never mentions it, but Ruby and Python are mentioned near constantly.
I'm sure working at Facebook would be amazing. I mean, it's Facebook. But if I also got internship offers at Google and other high-tech companies, then the language I use at work will factor in.
And PHP doesn't seem nearly as significant as these other languages, so then why take a job where I'll learn and use it in-depth for months when there are other languages?
The reason you don't see mentions of PHP all the time on places like here is that Python and Ruby are considered "hip" languages right now. Every one and their mother wants to learn it to show off how cool it is. Which is freaking awesome because the more people that learn nice scripting languages the better, but it means people aren't being driven to build new services on PHP to show off because instead of listing off 10-20 buzzword plugins by other people, you have a limited amount of mature things you can use to make a PHP application. This is not saying that Python and Ruby don't have mature platforms and extensions.
Have you done any professional programming in the past? I absolutely guarantee that even doing an short term internship at a company using a programming language you don't know, the nuances of that specific language won't be what you take away from you but rather the different ways to think about a specific problem.
Maybe once every month I face a problem at work or on personal projects where I can say "Hey, I remember this, it's a really obscure PHP fault!" versus many many times a times a day when I think "hmm I could build this as a singleton or a factory or a ....." and can use my previous experience programming in those fashions at previous jobs to figure out what the best way to do it currently is.
Learning a new language isn't about dedicating your life to it. It's about learning new methods of completing tasks, which you can almost always apply to other languages.
You should also probably look at surveys of language adoption b/c PHP has much greater market share. Hacker News is a very skewed sample.
Most back-end services (ie, the systems that build your feed, or detect spam) are in C++. Java is used in some back-end services (including, for example, in Hadoop, Hive, HBase, and the messaging product) and for the Android app. Objective C is used for the Facebook app, Messenger, Camera, and so forth on iOS. Python is used primarily in the automation and operations space. You will also find a bunch of Ruby, Haskell, Scala, and so forth around.
I am not generally a fan of PHP and much of the ecosystem around it, but using it at Facebook is very different. I also would not say that time spent learning and using PHP is time wasted - the important things to learn typically transcend language, and learning anti-patterns / deficiencies is useful too. That is also why Facebook does not expect any particular language knowledge before you start/when you interview.
Rails is a permanent train wreck. The other hundred of Ruby-based Web frameworks are adequate for small, CRUD-style applications. (BTW, I like Ruby. It's a neat little language.)
In the end, it's either PHP or J2EE in 90% of the cases for high-uptime, high-traffic Web destinations.
You should read what Andrei Alexandrescu has to say about the language here: http://www.serversidemagazine.com/news/10-questions-with-fac...
Underlying your question is the idea that the specific language you work with is an investment that's critical to future success. Whether this is true depends a lot on what kind of career path you want.
I've found that lower quality jobs are the most specific about languages - "Must have 5 years of Java 1.5 or above experience" should be a huge red flag, because that place is hiring based on years-of-ass-in-chair rather than skills.
Some companies seem to be looking for specific language skills - "We're looking for great python hackers" it might say. But this is often just marketing and doesn't mean they won't take a someone who can show excellence in other ways.
There are exceptions of course - if you are doing low-level systems work, it would be expected that you know the ins and outs of C, and I'm sure there's other examples in other specialties.
One last thing: it's always useful to get experience with a range of languages, and that will pay off down the road when you have to learn language N+1. At Facebook I've written (in descending order of volume): PHP, Javascript, Python, C++ and Haskell.
But, I wish for brilliant, hardworking people a better endeavor than a CRUD Web site.
There are a few things PHP gets accidentally right, though, and one of them is the execution model. Each request starts with a brand new empty PHP environment; runs in a single thread to completion; and must keep persistent state off to the side in a database or memcache or what have you rather than in language-level objects. This turns out to have been a really good set of decisions. It lends itself to a nice tight development loop: instead of save/recompile/restart the server/test, you basically save/load the page. It's easier to remember what the heck you were doing when you get feedback on the code you wrote in 500 milliseconds.
Personally I'm not hugely excited about it but it can be a good way to start a career.
I didn't know they accept non native engineers; that's another thing I forgot about; if a company really would like top talent, what's with the closed-border mentality? If Facebook doesn't have that, then kudos to them. If you want talent, it shouldn't matter where someone is from right?
They also generally don't have the same attitude towards hiring and are definitely not hiring for top talent. People are hired because they fit in the company culture first, and because they have potential second. Young engineers are paid cheaply and are not expected to be skilled; they are trained on the job.
Somewhat related: http://news.ycombinator.com/item?id=3845850
It's definitely possible to get hired as a foreigner in a Japanese company, but it's not easy and the conditions are not great, compared to Facebook et al.
My entire family and many of my friends live in another country. Apart from infrequent Skype calls the only way I can interact with them is via Facebook. I am closer to them now than when I lived an hour's drive away and we communicated by email. The first pictures my parents will see of their grandchildren will be on Facebook. It's awesome to think that I've helped build something that is helping millions of other people in the same way.
Social networking isn't a fad, about sharing cat pictures, or something bored teenagers do. Engineers look at Facebook and see a web site built in PHP with "a nice tech stack". Everyone else sees a way to fulfill their need to connect with people.
* Friendship for me is something offline, mostly. I don't believe that 'remote friends' make a lot of sense. That's a digital version of pen pals (email?) or collecting trophies from trips around the world. Socializing doesn't happen online for me, 'friends' that I cannot see offline will most probably not make it with me into the future. Facebook is a way to drag those people along that in my world just wouldn't have made it anymore.
* You totally ignored the biggest complaint in this discussion: Sharing stuff with a company that has a less than stellar reputation for respecting privacy. I'd argue that the bad reputation among engineers mostly stems from this issue, not from a weird kind of 'maintaining friends is a waste of time' idea.
That said, I _do_ use FB right now (living in IL, parents and family in DE) to connect with family and I have to admit that this works to some degree. I'd have preferred to do that more privately (diaspora? blogs?), but convenience and ease of use have won here.
Now all you win is a job at post-IPO Facebook.
Talk about a down economy!
When has this kind of data ever been successfully anonymized?
From Netflix's attempt: http://www.securityfocus.com/news/11497 (First link I googled, but has the gist)
My guess is the data is either something public or a non-user facing dataset they collected internally (like what coworkers have you bought lunch for)
http://www2.lse.ac.uk/newsAndMedia/videoAndAudio/channels/pu...
It helps them find high school dropouts in Maine who might be great employees, but would otherwise never have shown up on their radar.
I suppose it is one way to weed out those who would not be likely to apply to Facebook even if they did well at the contest.
The challenges can help corporations and others from solving complex problems. No reason why Facebook cannot take advantage of this process.
1 http://techzinglive.com/page/927/166-tz-interview-anhony-gol...