Black holes form before any infinities. They form when enough mass-energy occupies a small region of space. And neither quantity is infinity. Due to how energy is related to wavelength, and that we need smaller wavelengths to probe smaller, and because everything has wavelength, we get that smaller scales require more energy (this is a simplification but correct). At a certain small enough size, again not infinity, we get a black hole due to energy density of that region of space. And any more energy just makes a bigger black hole. So we can’t actually get endlesssly smaller scales. The singularity is also a mathematical one and not something most physicists claim exists physically. I mean as a related example, there’s no way to physically infinitely divide space so infinities of calculus don’t imply infinities of spatial division.
QM I’m less sure where you think infinities pop up physically? One interesting thing is you’d need an infinitely size measuring apparatus to have absolutely certain measurement results due to random fluctuations, but as per above we can’t have infinitely size devices except for infinitely sized black holes, which won’t really help us. A lot of this is said more rigorously by Nima Arkani Hamed in his recorded public lectures.