Debug information often is choc-full of environment specific goodies that can easily cause builds not to be reproducible.
For example, debug information for several languages I've worked with embed the full path to where the source code file was originally compiled. This can easily vary across two machines in a way that when debug information is turned on, the builds are different, but when turned off they are the same.