Feynman, Richard. "Simulating Physics with Computers," International Journal of Theoretical Physics, vol. 21, Nos. 6/7, 1982.
Shor, Peter W. "Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer." 1994.
I'm also nearly done with Scott Aaronson's Quantum Computing Since Democritus, which is a popularizing treatment derived from graduate-level lectures. It is demanding but super fun.
So one risk to quantum computing I wonder about is the error correction. There are lots of attempts at classical computers that purport to give the same polynomial->exponential speedup, but on closer inspection they just "hide" the exponential requirement, e.g. in the need for exponentially-increasing instrument accuracy. Are there any experts here who can give a reason why error correction in quantum computing will scale polynomially or better? It seems like if we are hiding the exponential in quantum computers somewhere, that's where it will be.
EDIT: I think there are practical risks also, e.g. superconductors that only operate at near-absolute-zero, but I'm asking about a theoretical risk that just kills the idea.