Anosmia is much more serious when it's the result of trauma or some other disease - it makes food taste radically different, and is likely to cause depression. That said, I've never had a sense of smell, so I don't know what I'm missing. And the world is much less smell-focused than vision or hearing, so if you have to lose a sense, smell is near the top of the list.