Yes, but even still, that's a decision that no one but you ever could have made for yourself. There's no shame in dropping out of college (or even being forced out) and going on to have a kick-ass career. The stories of Bill Gates, Steve Jobs, et al., can attest to that. But even those guys went to college at first, before realizing that it was slowing them down or sidetracking them. It's hard to say if they would have had that self-knowledge without trying out college first.
Even if someone had told your 18 year old self that college wasn't your only option, you probably wouldn't have believed him. The idea of college-as-necessity is so firmly ingrained in our national culture that only an unusually self-actualized 18 year old would know, right off the bat, no experience required, that it wasn't for him.