Instead of rescinding the acceptance, we let Student2 join. Of course we also admitted Student1 to the department as well.
It turned out that Student2 (the candidate we admitted by mistake) performed much better than Student1. :-)
Regehr notes a similar observation. http://blog.regehr.org/archives/147