That is correct -- by "noise", we don't meet pixel noise, but instead a stochastic process (in fact, different processes different properties which we compare in the paper) from which we can sample large amounts of varied training images.
Except your not actually training on noise, your training on procedurally generated images which include random modifications. It’s just the summery is really bad at describing the process.