The ratios between 650AU, 165AU, and 0.01AU are somewhat moot.
In 1957 Sputnik 1 had an apogee of ~900km from the Earth.
By 1969 NASA was sending rockets ~385000km to the moon.
By 1979 Voyager 1 & 2 were reaching Jupiter ~5AU from Earth.
We went from 900km to 5AU in 22 years.
If SpaceX achieves their stated goals of lowering $/kg to orbit and rapid re-usability with Starship it will unlock things like asteroid/lunar mining and space based manufacturing which will allow the construction of the kind of infrastructure needed to make distances like 650AU achievable in reasonable time frames.