I would recommend not drinking from your bidet, after which this is a moot point. Most things in bathrooms have small amounts of fecal matter on them.

To actually answer your question, this has never been a visible issue for me in the many years I've used one.