I just say "To be honest" when I want to signal I'm about to say something that someone doesn't want to hear or that is slightly inappropriate