I do exactly this too for the occasional mail that I really can't read as plain text.
One concern is that I'm letting through all web bugs and, perhaps, outright malicious HTML. If anyone has a solution for that, something like filtering the HTML, I'd love to hear it.