If we allow that, attackers could hide a codepath in the binary that only activates for a specific build time in the .metadata section. That would defeat the purpose of reproducible builds.