But raw dogging capacitors in CRTs is such an overtly straw man argument in this conversation. People who are cleaning bathrooms for the first time can hopefully be trusted not to drink the bleach, right?
If someone licks a running table saw because an LLM said it would be fine, we're talking about entirely different problems.
What you seem to be missing is that LLMs are better at/for some things than others. Legal review, 3D geometry, therapy and apparently chemistry are off the list.
It doesn't make sense to project that onto domains where it excels.
I guarantee it is using the same system to write code and teach you about electronics that it is using to teach people about chemistry, and if you can't see how that means the resulting information is suspicious at best, then I don't even know what to say anymore.
It's genuinely alright to stfu sometimes when you don't have anything productive to add to the conversation.
Perhaps I'm just pearl clutching. I guess time will tell.