If you 'smell it' you subconsciously feel like you are forced 'smoking it' akin to involuntary second hand tobacco usage. Whether that is true or not I do not know.
As a former tobacco and former casual marihuana smoker I dislike either of these smells. I consciously quit both, both for very good personal reasons.
There are obvious health related risks to abstain smoking tobacco but for me I have autism and marihuana can make me over-sensitised and get me into a psychosis. This occurred numerous times.
Yes, there are benefits to marihuana and specifically CBD. My uncle had terminal cancer and hash oil helped him against this pain (he was AFAIK never pro-drugs or pro-marihuana before he got cancer). And there are disadvantages as well. I'm a proponent of education and regulation, just like with alcohol.