I do but I don't mind it. I wear a thin head-cap and bought the 'VRCover' which helps absorb the sweet (but is unfortunately made of cotton for some reason). My setup is in the basement too and so it's typically pretty chilly down there so it's probably not quite as bad as it could be.

I do have to take the headgear off every few games, towel off head/forehead, and clean up the lens.