The only reason I've found to avoid it is that 1 time in 10, coffee before a long ride means that I'll urgently need to pee every few miles -- way more often than I can find a legal place to do so.