Sending text-only is probably a weak spam signal as far as Gmail is concerned; for the majority of mail to the majority of recipients (though yours may be exceptions), HTML email - even if very basic - offers better layout/design options and better readability.
On top of that, of very old-school users on Mutt or Pine who prefer text over HTML, I'd think a significant portion of them don't have their mail pass through Gmail's filters.