Folks in quantum computing seem to think that's it's a near-certainty, "just an engineering problem." As long as you don't ask for a specific timeline, they won't even lie.

The "Too Much Crypto" paper is pretty reasoned.

See section 5.2, and 5.2.3 - "Should we care?"