this is cool. i suppose it's only a matter of time until we see optimizing compilers that use transformer-rl style searches for subsets of their optimization and codegen.
rl-searches could potentially rewrite entire algorithms.
edit: (more musing) maybe the future of software engineering will be authoring bullet proof acceptance tests.
Edit, found it Transcendence (2014), also it seems my brain injected some random thoughts into that plot, it's not about that at all but the point stands!