See also Artifact Evaluation, a process used in several PL/SE conferences that makes evaluation of code (and datasets/studies) an explicit step in the review process:

http://evaluate.inf.usi.ch/artifacts

http://www.artifact-eval.org/