> I've never thought of it as a pejorative, and I don't know anyone who has.

Listen here, nerd! It's a pejorative if you use it as one.