Hacker News Reader

Or corporations: https://www.zylstra.org/blog/2019/06/our-ai-overlords-are-al...

Corporations aren't AIs, they aren't as powerful as AIs, and they don't think like AIs. I have mathematical proof. Show me a corporation that, as a whole, satisfies both invulnerability to dutch book attacks and has a fully total ordered VNM compliant utility function.

That merely makes them stupid AIs.

I guess I failed to understand the point. What I mean is that arguing that AIs can't be a problem (something that I'd like to be true, but probably isn't) because companies already are superhuman does not make sense, for some pretty simple mathematical reasons.

The point is a philosophical argument about what constitutes a powerful non-human agent. Nobody is arguing that corporations are literal thinking computers.

> arguing that AIs can't be a problem ... because companies already are superhuman

Quite the opposite, actually: corporations can potentially be very destructive "paperclip optimizers".

What makes you think that AIs would be VNM rational?

They should either be VNM rational or have surpassed VNM rationality. Anything else is leaving utils on the table (though I suppose that's kind of tautological).

Reply on news.ycombinator.com