Hacker News Reader

Most comments here point to the owner of operator of the LLM. I tend to agree. But on the other hand, if you drive on the highway and the steering wheel falls off and your car glides to the left and his an oncoming car, it can be argued that it is true producer of the car, or the mechanic who didn't tighten the bolts...

View on HN

The difference is that a car is known and expected to work reliably. An LLM is known and expected to randomly do crazy shit because that is how the machine works. Therefore, if you are using it as if it were reliable, you are being negligent and should be held accountable.

Companies don't market their chatbots that way though. If they mislead someone into thinking their product is anything other than a completely unreliable chat bot and a person falls for their lies the company should share the responsibility. If a company who makes a chatbot advertises that it can be used for something and a consumer uses it as directed and it causes harm the company should be responsible.

You’ll encounter some very bad news if you do some research on the state of the law as it applies to suing people for defective software. All of the things that you’d like to be able to do to a manufacturer of a car whose steering wheel falls off, are things that you would have a very hard time doing to a manufacturer of software, which is not a tangible item, and which is generally covered by a warranty that discharges all these responsibilities.

Reply on news.ycombinator.com