What are your goals when you get out? Just because someone is interested in start-up culture/hacking doesn't mean they are meant to be an entrepreneur and apply to a startup program. They are completely separate things. If you love to hack, and are good at it, you can get a great job at a top company/consult/join a startup. Maybe joining a startup for 2 years right now would be great. It may take off and you won't need school. If not, you were already two years ahead.
My situation is a little different, I'm 18 and graduated from high school this past June. I chose to forgo university to start a company. I am a non-technical founder and so I don't do the hacking, I do the biz dev. Best decision I have ever made. But that is in my situation. I don't sit around and just do charts. I read 4 books a week, trying to learn as much as I can. For me, I am better at learning from myself than I am under a schedule over 4 years. I can absorb way more info at a faster rate this way.
The decision is completely personal and up to you. Just go with your gut, and don't care about other people. When you are successful, no-one cares if you have the letters beside your name. The better PR story is the kid with no college. The downside is the average job force applications later on. It doesn't sound like you are an average person, so I wouldn't worry about this.
Best of luck!