Unemployment and poverty are always going to be there and never be 100% removed. Not in the near future.
Wouldn’t starting a space mission create thousands of direct and indirect jobs?
These advancements are not taking money away from them. The research we did towards all of the space travel in the past 6 decades have given us dividends on several fronts.