This graph shows that the drop off was nearly identical for men.
Maybe the initial bump was just people getting overexcited for this computer thing and then hearing from their friends that it's kind of nerdy.
Edit
Another interesting link seems to show that women receive degrees at a significantly higher rate than men, and that the gap is widening: http://nces.ed.gov/fastfacts/display.asp?id=72
Why is this?