Dedup was rushed and the original developers admit it. They ask you to please not use it unless you absolutely know what you're doing