Agreed, I think this is the strongest counterpoint. But it effectively requires restating the point to clarify that it's tying up minds, time, energy, which are non-trivial things; but not infrastructure.

They may be brilliant, but if they're string theorists, they aren't scientists.

Or at least that's Woit's point.