Of course second hand smoke causes disease - we know that. But you have to consider the context in which we attacked that. The second hand smoke they're referring to is nearly constant smoking indoors, which was standard in the past.
Smoking blowing smoke in your face once is one time and outside. It's easily millions of times less smoke exposure than what you're referring to here.