Recurrent Looped Transformer

there's also more fun stuff like https://www.electricalvolt.com/cvt-constant-voltage-transfor...

A fairly obvious theory at that, unless I've critically misunderstood what's being described. As with so many obvious ideas I've always assumed that the reason I haven't come across it in the wild is because it doesn't work (or is comparatively inefficient, or tends to blow up during the training run, or etc).

> Realized reasoning gains, hardware efficiency, and RL scaling remain to be established.

Yeah so the first entry in that list is - if I may be so bold - typically what you'd start with at a small scale _before_ writing up and publishing your "genius" idea. This is the usual crank with delusions of grandeur presenting something straightforward that he hasn't tested as though it were a working breakthrough.

Ironically the cost of testing such theories has fallen to an all time low given the capabilities of coding models. I wouldn't be surprised if a frontier model could one shot a test of this.