In the near term, a big worry is corporations optimized by machine learning programs. Classical economics says that corporations exist solely to maximize shareholder value. That's a clear objective function one can give to a machine learning program.
It's already happening. Right now, about $400bn in hedge fund money is run by programs. Once computers are better at that than humans, the companies directed by AIs will get more funding. Investors put their money in winners.