46 karma · joined August 1, 2022
I know this sounds cheeky but we all have brains that are good at some things and have failure modes as well. We are certainly seeing shadows of Human-type fallability in neural nets, which somehow seem to have a lot of similarities to human thinking.
Brains evolved in the physical world to solve problems and help organisms survive, thrive, and reproduce. Evolution is the product of a massive search over potential physical arrangements. I see no reason why the systems we develop would operate on drastically different premises.
I feel like a pinch hitter: I can do a couple innings at a high level of performance, but I can't keep that level up as long as I used to.
OTOH I think I have better judgement when it comes to deep, complex questions of long-term architecture choices. My "meta-programming" skills are sharper than ever.
It's counter-intuitive, but locking up a technology is like trying to control prices and wages. It just doesn't work -- unless you confiscate every GPU in the world and bomb datacenters etc.
The best way to align with the coming AGI's and ASI's is to build them in the sunlight. Every lock-em-up approach is doomed to fail (I guess that makes me a meta-doomer?)
I get the feeling Ilya might be a bit naive about how people work, and may have been taken advantage of (by for example spinning this as a safety issue when it's just a good old fashioned power struggle)
Internal Server Error - Request ID: 01GEN0YR9YVQ4Y9EMR2XTTF6NA