The Zeroth Commandment
scottaaronson.com
scottaaronson.com
If I were to choose a personal Zeroth Commandment along these lines, I would, at the very least, hold the bodily autonomy of everyone to be important.
(Of course, the bodily autonomy of women is more often violated than that of men, but that doesn't mean that one should fail to respect the bodily autonomy of men or of non-binary folks.)
1) He writes a long blog post about problems that men have, specifically, and how there is unfair treatment between sexes.
2) He also writes explicitly that bodily autonomy of women is so important to him, it might as well be called holy.
3) He has had his son circumcised.
Any two out of these three positions i could understand. All three together are... hard to rationalize.
Of course we should feel bad for people, both men and women, who cannot fulfill their sexual desires, for whatever reason.
This is not a radical thought. That the author does such an elaborate dance around this simple statement seems unnecessary to me.
The comparison to people who are financially impoverished is a legitimate one.
Just because there is no "good" solution to severe sexual frustration - no solution that preserves the autonomy of desired yet unwilling sexual partners - does not mean we are prohibited from feeling compassion and sympathy.
When I said there was no good solution I was thinking more for people who want sex without paying for it.
Under the gracious assumption that your agents are implementing a reasonable protocol for information exchange :)
Combined, these give robust decision making methods. However, none of the above concerns actual hypothesis making which is biased from the get go.
Bayesian statistics cannot answer the question of how to build hypotheses, only maybe how to value them. Sometimes.
If we solve the question of how to make hypotheses reliably, then we might have some angle of attack on the strong AI problem.
Related problem is deciding ways to falsify statements - inverse Bayesian reasoning. That is, given posterior probability, figure out potential priors.
This is not a new question. The solution is ‘the oldest in the world’.