Hacker News Reader

I don't buy this at all, you're attempting to model a "superintelligence" and the idea that your 100-150 IQ mind is able to properly guess what a being order of magnitudes smarter would think or feel seems like nonsense

View on HN

Well that is fair, and I think that is the entire concern with artificial super intelligence isn't it? That we can't predict what it would do.

If I could accurately predict what a superintelligence's goals would be I'd have a decent career advising AI companies on their alignment concerns :)

Just taking a swing at it with this ol' legacy wet brain because it's fun to think about. There's nothing to buy, it is an opinion. Heck, it's practically just an exercise in writing science fiction at this stage.

What do you think it would do?

A focus on intelligence as being the most salient feature of one's awareness seems like a human thing. I assume that an octopus would wonder how many arms the AI has. Maybe the AI will relate to itself first as a distributed being rather than as an intelligent being, who knows.

Reply on news.ycombinator.com