I've learned (well, maybe) the hard way that if you say stupid things, it damages relationships. Now the reason one might keep doing so is that usually it's a lot more fun to say questionable things...
Alas. But yes, you have to be very careful with what you say. It's many times harder to overcome a negative impression than to create a positive one.