It's never very foggy east of Fillmore street, even in the summer. YMMV but SF weather is only miserable to people from LA.
If you're talking about "The coldest winter I ever spent was a summer in San Francisco.", Twain never actually said it: http://www.snopes.com/quotes/twain.asp