AIs which just answer questions people pose seem to be mostly harmless. Some people might not like the answers, and some of the answers might be wrong. That's true of web search results now. That's just an extension of the social media controversy.
AIs which have authority over people are scary. "AI says No!" This is a corporate power problem, not an AI problem. If corporations or landlords have arbitrary discretionary power to affect people's lives, that's the problem. Not that they delegated that authority to an AI. The EU regulates decisions against individuals made by algorithms. The EU has already stopped Uber from "robo-firing", where the app back end fired underperforming drivers.
Few proposed AI laws make this distinction. That's because it would raise the issue of arbitrary exercise of power and collective individual rights. That might lead to political unrest, or even unions.