Anil Dash actually wrote a great article about this. The short summary is you need real humans doing the moderating. All the tooling you create should be about enhancing those humans.

http://anildash.com/2011/07/if-your-websites-full-of-asshole...