If the system is already broken, and someone taking advantage of it is making things better, I say let him take advantage of it.
He will continue greasing palms (with stolen money) and start again with his corruption. There are numerous examples of this being the case.
A good example is Jurgen Harksen. He was on the run from German authorities and decided to hid in South Africa. He quickly started on the corruption bandwagon again and formed close "relationships" with various politicians.
A leopard does not magically change its spots.