The approach that http://www.pixelbeat.org/fslint takes is to md5 and sha1 the files to avoid false positives.

The core of the duplicate detection is the shell script here:

https://github.com/pixelb/fslint/blob/ffcd3b85/fslint/findup...