Firstly, great idea.

I'm assuming there will be some sort of rating system for arbitrators in the future. That list on /u could get unwieldly.

However, what's to stop an arbitrator from gaming this service and faking his reputation?

For example, he could send transactions between himself all day, using himself as the "arbitrator", and build his fake ratings that way.