Surprised no one suggested AllDup. It's the best tool I've seen for working with duplicates: http://www.alldup.info/en_download_alldup.php