Hacker News Reader

Someone who left DeepMind over Google's agreement to provide military AI to the US government tried to get Jeff Dean to quit too:

https://turntrout.com/why-i-left-google-deepmind

Maybe this is what happens when someone with Jeff Dean's standing tries to quit?

TBH, I'd rather have Jeff Dean working on the creepiest-possible tech for ICE than joining the race to automate AI research. Automating AI research is terrifying.

View on HN

If you check out some sub-tweets from people in the org, it wasn't really all butterflies internally for a while. Sorry, really don't want to name people and give examples.

> Automating AI research is terrifying.

what why?

Skynet.

It depends what they mean by automating. But the classic argument goes:

* Each new generation of models has emergent capabilities we did not anticipate.

* We already have trouble monitoring and controlling the current generation (see HuggingFace incident).

* The more we let models shape their successors, the more out-of-distribution each generation's learning environment becomes.

* If not done carefully, we risk creating extraordinarily intelligent and powerful models with unintended behaviors, like deceptiveness or power-seeking.

Reply on news.ycombinator.com