With HTML, I can do everything as a <div> and the eyeball reader doesn't know/care. Where it matters is that I'm stripping semantic meaning, which hurts computers and possible accessibility devices.
Most of my life, the same has been true about dashes. I use - for every one of the kinds you provided because - lives on my keyboard.
Is there real value in caring? Does it have the same semantic—stripping effect for computers/accessibility devices? The part of me wondering if I really should care is trying to suss out if this is a real problem or just an argument for semantics pedantics.