It's not new. A paper in 2021 [0] showed you can train a quadruped robot to walk in minutes using parallel simulation in GPU, and then deploy it on the physical robot. Being parallel it is faster, and more so if on GPU. But sim-to-reality transfer is still a concern, and the architecture doesn't help if there are sparse rewards.