There is a rail line that goes from Sacramento into the South Bay (ACE Rail) which is what you'd probably try to use if you could. Still takes 2.5hr one-way (which doesn't include last-mile parts), but at least you don't drive.
I used to take it going from Pleasanton to Santa Clara, and I remember there was lots of revelry on the way back home.