175 karma · joined October 28, 2013
The major difference from previous platform shifts is that the limits of frontier AI technology are extremely hard to gauge even for experts. Unlike AI tech, previous platform shifts are easy to understand for a person on the street. For e.g., consumers can see that smartphone allows messages to sent over cellular data, which is better than SMS. But it is not obvious whether Echo is better than Siri? Tesla's driver-assist more reliable than a competitor one?
I feel the recent breakthroughs in AI are concentrated in a small number (but very important) areas such as computer vision and to some extent machine translation. There need to be more advances especially in areas of decision making before AI can have a broader and more meaningfully impact as stated in the interview.
Sounds like active learning to me. It's a type of machine learning where a learner pro-actively ask for interesting data points to be labeled so that he can learn more about the system. :)
However, the tutorial doesn't work towards a working implementation. I think you can verify your results against benchmark problems. There are a number of good implementations around:
UCT implementation with many MDP benchmark problems: https://github.com/bonetblai/mdp-engine
My favorite implementation. The code is quite easy to read: http://www0.cs.ucl.ac.uk/staff/D.Silver/web/Applications_fil...
It is also very easy to work with, you can easily tweak the algorithm and add heuristics for your specific domains.
Also relevant:
UCT applied to partially observable game (Poc-man) http://papers.nips.cc/paper/4031-monte-carlo-planning-in-lar...
Another approach for Monte-Carlo planning http://papers.nips.cc/paper/5189-despot-online-pomdp-plannin...
Also important to note TensorFlow is probably not the complete package of what they use at Google.
further extension, pull out quick answers from other emails, i.e., "what's the sales number this month?" "100M" from another email
2. my newsfeed is never ending. Am I going to spend 5-10 min reading an in-depth article? and I know nobody else on Facebook will like/comment/discuss the long article with me.
[1] http://road.cc/content/news/162468-cyclist-doing-trackstand-...
On a separate note, the robobrain project http://robobrain.me/ seems to fit the running themes in the paper.
Whenever u want to do something on the web (e.g. buy a ticket), u have to figure out how to login (worse if you have to create a new account), how to make payment, and check your emails for confirmations and updates. That's enough friction to make a user hunt for alternatives. On top of that, the website make not work well on your mobile phone.