181 karma · joined September 6, 2013
Formerly BigQuery@Google and SecurityHub@AWS.
This is the meaning of stable in the stable marriage problem. And the Gale-Shapley algorithm does this.
It's still a huge number though.
http://www.nytimes.com/2015/01/21/technology/google-makes-1-...
It seems like the AI is identifying equivalent answers among respondents. So if you mark an answer correct on one test, every other test with the same answer will be marked correct. I worked for a small competitor of this product in college and we had a lot of trouble with this problem, especially with answers that were prone to spelling mistakes, or could be written in many ways. Kudos to them for doing this well.
Another fun bit of AI in this space is in identifying where the answer key might have made a mistake. We developed some algorithms for determining the most likely answer to a problem given the responses. We never released it but I worked on a tool that would grade tests without an answer key at all. Using 50 question tests in a few freshman physics classes I was able to get the right answer a little over 97% of the time.
> (Zuck) announced the formation of a mysterious research-and-development group known as "Building 8."