It matters for grad school and for teaching jobs (transcripts are part of the application packet for K-12 and post-secondary teaching positions), but otherwise it doesn't matter.
Well, doctors and lawyers, as in some of the most powerful people in the country (supreme court justices, etc) have to get graduate degrees.
Maybe it doesn't matter for software engineers, but it matters a lot for the power structure of our society.