Sentiment Analysis on Enron's Emails with Apache Spark

More like a, you know, "Look, Ma -- I got Spark, Hive, and HDFS on my resume now!" analysis.

"Who did Ken Lay like best" was originally going to be the title of the post, until we realized that you can't actually answer that question. It was someone else's idea anyway, but I'm not naming names!

That said, I only had so much time to work on this, and there was a limit to how much depth I could go into. I wanted to go deeper and introduce some network science / social network analysis but had other priorities.

But still, the point was just to illustrate a cool application of that particular technology stack and pique people's interest in it. If that interest helps us land business, that's a nice outcome. If not, maybe somebody learned something or came up with an idea for their own project, as a result of reading it. Those are nice outcomes as well. :-)

There are plenty of more interesting questions ("when did Enron employees start getting nervous or alarmed?")

That is a pretty good one... maybe somebody else will take the bull by the horns and write a post on that. If not, maybe I'll do it later for a "part 2".