Most people aren't thumping the dictionary like a fundamentalist might a Bible, they're just pointing out that they have a different understanding of the word than another person does. Language is useful when everyone's on the same page.
And especially regarding words drifting toward hyperbole, exaggeration, and sometimes simple misuse, sometimes it makes sense to resist the change. Compare this to cultural drift as a whole - sometimes, it drifts away for the worse and people calling it out as such aren't necessarily being obtuse just for the fun of it.
Sincerely, a person that refuses to let to of the whole "literally" thing. I'm great at parties.