Ya, if you're coming to SJ and looking for things to do, my first suggestion would be to get out of SJ lol. When you have time, take a trip down to Santa Cruz, as Chippy suggested. There's a bus that goes from Los Gatos to Santa Cruz, I forget what it's called though.
Caltrain goes from SJ to SF, so I recommend taking advantage of that.
You can also take Caltrain to Bart and go over to Oakland and Berkeley, which are both really cool.