They're out on the ice the entire game, and usually the only person on the team that can play that position at any acceptable level. That on top of goalies being your last line of defense, having to take 25-35 shots per game.
The same reason your team fights a lot when the other team messes with your goalie; can't afford an injured goalie.