Inspired by this, I stayed up all night building this!

https://jsbin.com/josuxarufu/1/edit?js,console,output

It tries to "evolve" the target image (right) by making random changes to the origin (left) -- output after 1 step is in center.

It's eventually supposed to be a genetic algorithm, but for now it just goes through it pixel by pixel, and if the pixel doesn't match the target, it inverts one of its neighbors. If that's beneficial (checking loss in a 5x5 rect centered on the test pixel), we keep the change. I get loss down to about 25% then it plateaus.

Feel free to fiddle, fork, etc! (I stayed up pretty late so the code is bad! Suggestions welcome!)