Well, if you think society is unkind because it's tough with a degree, I'm not sure what you'd think about what it's like without one. :-)
I'm not the normal person without a degree, but the time I didn't spend in college/university was spent learning about computer security. I didn't blame anyone for things not turning out how I wanted, I did something about it.
Someone once told me that there are only two ways to change a situation: you can change the conversation you are having with people or you can change the people you are having the conversation with. You have to be in the conversation though.