That's inside the DC, right? I'd think that even with current generation GPUs the noise of the fans won't be audible outside the building but the cooling infra that is outside the building plus (backup) power generation through gas or diesel generators.

EDIT: recently I read about (I guess on HN) a new planned Amazon datacenter that was super environment-friendly. So in fact it might eventually be possible to create silent DCs but we'll see how this turns out.