Sure, but this is like saying you shouldn't replace your cardboard box with a safe because it could get cracked.
Once it's good people will outsource the work to what is essentially a CA system where every BMV in America is an issuer and I expect it to hold up at best as well as SMS verification.
Why not let notaries or an authoritative agency issue cryptographically signed one time codes upon inspection of your physical ID? Frankly, it sounds like a superior system to me.
https://www.thetruthaboutguns.com/liberty-safe-changes-its-p...
there's a point to be made for expections of strong security where it's actually weak, but is no security at all really better than bad security?