Flossing isn't about your teeth so much as it is about your gum health. Nasties that get in your gums will get into your blood stream, and there's a high correlation between gum inflammation and generalized inflammation, even heart attacks. Some researchers even believe that inflammation that starts in places like your gums is a cause of heart disease, rather than just a comorbidity. This is not a very "out there" hypothesis, either.

Don't skip flossing just because you haven't had a bunch of cavities. Your teeth may be special, but is your heart?