The Argument Against Quantum Computers by Gil Kalai [pdf]
arxiv.org
arxiv.org
(Even this paper, ultimately, relies on Conjecture 4, which essentially comes down to saying that "Well, we've proven this one particular system runs into noise issues, so we're just going to assume that some grand physical principle will cause this to extend to every possible small noisy quantum system.")