Are people having success with hiring based on problems like this? I've seen it at Dropbox, Facebook, Bump, Quora (and many others). While I agree that it would remove the chaff from the job submission pipeline, does it fill it with enough quality candidates to make it worthwhile? I know in at least one case where I played with a problem that the "easy" solution was not appropriate at large scale and it wasn't worth the time to spend the time researching the problem space for an optimal solution.
Anybody else have experiences either positive or negative on the hiring from (candidate or employer)?