We don't know this for a fact. There are quantum annealing algorithms for factoring numbers.