I came here to leave this exact comment. A possible counter argument might be that people think computers are much more infallible than people (even if that's not objective reality).
Computers are, LLMs are not.
We already live in the world where you can learn anything from an "expert" on YoUTube. All AI does is remove the person at the other end. It's possible to learn some real dangerous stuff on there, too, like doing electrical work without properly disconnecting power first, or car maintenance that could fail and cause more damage. The problem isn't people assuming sentience and trusting AI, it's that people already are too trusting without verification.
With a positive spin: at least AI isn't actively malicious and doesn't try to get people to do dangerous things 'for the lulz'.
> All AI does is remove the person at the other end
So all it does is remove the only liable entity in the process, "all", scaling a pre existing bad thing doesn't make it good
Experts on youtube are often still fact checked eventually. AI gives answers privately that may never be fact checked by other
It hardly is an argument, "people already kill each-other with their fists let's give them guns"