2,983 karma · joined October 4, 2013
https://www.linkedin.com/in/tristanhearn
I feel for the author, it sounds like a terrible situation.
Take any positive whole number, n.
If it is even, divide it by 2. (n = 2n)
If it odd, multiply it by 3 and add one. (n = 3n + 1)
Repeat. If n = 1, stop.
Does this process always lead to 1? It seems to, but who knows.
In other words, rather than apply GAs to the optimization of a large complex system, these days the paradigm seems to be to find a way to derive the needed gradients (or extract them via automatic differentiation). Does this seem to be the case, or are GAs still shining in some applications?
A cool thing is that means you can do linear algebra operations with a matrix (including solving linear systems) without ever needing to actually explicitly construct said matrix. We just need a recipe to describe the action of multiplication with a matrix in order to do more advanced things with it. This is why they are so popular for sparse matrices, but their suitability can go beyond just that.
Projecting problems into Krylov spaces also tends to have a noticeable regularizing effect.