When you think about the vast space of mind design space, plus all the ways we've made mistakes reasoning about even simpler & stupider optimization processes like evolution, I don't think they're being too silly.
If any of you want a quick and insightful introduction, this video is very good: https://vimeo.com/26914859
Right, which is an impossibility in my opinion. There is an inherent conflict between systems with asymmetric power and capability in a resource constrained environment. Trying to get around that fundamental principle is an exercise in futility.
That's like saying they aren't telling us how to make time travel because the grandfather paradox hasn't been solved.
They aren't withholding some unique secrets of the universe because we have unsolved problems... they are just slightly crazy people who can turn a phrase and pivoted that ability into an endless series of "grants" as to avoid needing to get real jobs contributing to GDP.
The output of their work is amusing, but just because someone runs around with veracity of purpose doesn't mean what they say is part of a ground truth reality.
Read it for enjoyment, but don't read it for belief.
As if those are unrelated concepts. The more divorced they are from real world AI software, the less relevant their results will be.
Reminds me of: https://www.youtube.com/watch?v=_ZI_aEalijE