For me the biggest annoyance is its insistence of "helping" you by auto converting double quotes into smart quotes.

Handy for nicely formatted prose, not so useful for code snippets.