Another benefit that hasn't been mentioned in the comments is that it serves as documentation. As new developers come into your team, you need to describe the infrastructure setup. Having your infrastructure defined in a clean repository is one of the best ways to do that.