A significant number of people in positions of power in the AI industry get their moral framework from science fiction books and a particular Harry Potter fanfiction. It’s hard to predict what ideas and philosophies will become important.
I call this https://wiki.roshangeorge.dev/w/Story-Logic_Bias
But that seems normal and historical. Stories are how we encode memorable concepts for transmission to each other and probably why the Bible is full of parables and so on.
Someone pointed out to me that said Harry Potter fanfiction author has written about this specific bias as well https://www.lesswrong.com/posts/rHBdcHGLJ7KvLJQPk/the-logica...
How do you reconcile the values of those proposing moratorium up to and including bombing data centers with those who are building them as being the same?
edit: posted is a podcast by Behind the Bastards about the Zizians, a death cult that branched out of rationalist community and which was responsible for six deaths, but it covers the rationalist community and the Harry Potter fanfiction as well.