Shrinking bull’s-eye algorithm speeds up complex modeling from days to hours
news.mit.edu
news.mit.edu
[1] J. Gardner, M. Kusner, Z. Xu, K. Weinberger, and J. Cunningham, in Proceedings of the 31st International Conference on Machine Learning (ICML-14) (JMLR Workshop and Conference Proceedings, 2014), p. 937
Simulated annealing is blind, what you do with simulated annealing you just move locally around the current point.
If you had a partial picture of the landscape of the function, how would you locate the most interesting unvisited point in the landscape?
I do have to admit that what I'm seeing here is only the application of Bayesian sampling algorithms, there are startups doing similar things for A/B testing and similar.
Although I'm vaguely familiar with MCMC and Metropolis, it's not nearly enough to pass comment on this advance.
My understanding of the article is that the new algorithm determines the parameters of iteration \i\ statistically from the results of iterations \1\ through \i-1\.
If I get through this paper quick enough, I'll post back any significant thoughts I may have (if any).