The primary danger of "AI" lies in the extent to which it has managed to convince people of it's capability to think and reason.
A lot of people clearly have no idea that they are essentially speaking with a glorified randomizer, rather than someone understanding the question.
This is bound to eventually lead to a disaster when someone deluded into trusting the "AI" does some stupidity it suggests without passing it through any reality check.