> I could just build in exactly the same way, using the same solution/project files, on my dev box and my build server
Do you run VS on your production servers? Because that's where it will shit a brick because you forgot to install ASP.Net MVC KB123123213 but the IDE installed it as part of update 4. Etc etc...
This problem gets VERY deep.