However, your friends are not the only smokers. A doorman may be slightly down wind of a 'smokers area' which get's a long swath of people over the day. Sure, he might get 0.1mg per smoker but multiply that by 200 people who go out twice a day and that's 40mg which is probably not lethal but still plenty to cause issues. Not to mention withdrawal issues on his days off.
In terms of e-sigs, the second hand dose is likely lower. Assuming the unregulated doses are as described. But, if people assume a poorly ventilated break room is ok then people who work next to it may also get a fairly high dose.