Hacker News Reader

In the sense of replicating the results, we do have CI servers and even fuzzers running for our "code replication".

I don't want to derail the science discussion too much, but what if you actually had to reproduce the code by hand? Would that process produce anything of value? Would your habit of writing i+=1 instead of i++ matter? Or iteration instead of recursion?

Would code replication result in fewer use after free, or off by one than code review? Or would it mostly be a waste of resources including time?

I'm not sure if it is meaningful to divert the topic to an analogy that is never precise. But I think we always rerun the same code (equivalent to the same procedure in the papers) in the CI or your workstation to debug. Replicating the result of the program doesn't mean that one would have to rewrite the code, as in replicating the result of a computer vision paper may only include code review and running the code from the paper.

Reply on news.ycombinator.com