They're talking about the visualization, not the physics. The agents aren't getting visual input. That would make things much, much slower.
So, as tlb said, I'm curious if all of that was added for the public release, or if the researchers set it up while running the experiments. It seems like it would be fun.