Silicon Valley is a truly special place and I think there is a lot of value in taking a year or two off of college and try working at a startup, traveling and/or pursuing whatever else seems cool and worthwhile. Then you can decide whether returning to college is the right thing for you...