Theoretically, what we want is for it to be illegal to solicit or offer a bribe. If we can construct a legal environment in which people can accept or pay bribes but report that in a constructive way, then the negative side gets riskier without making everyone involved co-conspirators.
Practical example: Tuna boats in the Pacific have onboard observers from one of the island nations that own the EEZs that are fished. Observers are paid okay for their countries, but not really a lot of money in the grand scheme of things. It would be a net positive if they could accept a bribe from a crooked boat owner and then report it once on shore. Turn over the money (with maybe keeping a small finders fee) and then that boat’s owner gets penalized across the entire Pacific. Now there’s a very strong incentive not to offer bribes.