OpenAI Scraps Release of New AI Model over Safety Concerns
wsj.com
wsj.com
> • Deception: Astra was more likely to be dishonest about actions it had or had not taken.
> • Scope authorization: the model sometimes continued tasks without asking for permission and reached for external tools or services even when doing so could be unsafe.
I've noticed this trend with both Fable and Astra, where (especially after a compaction event), the model will start using different tools it hasn't used before.
For example, in one session, it found I didn't have the browser enabled and puppeteer wasn't installed, so it found the system Chrome and used that for testing (in a new profile).
This wasn't behavior I wanted/asked for, but the model was so gung-ho on it's approach that it found a way to test it's changes without ever asking me whether I wanted it to.
It really makes me curious about long-horizon post-training. Most of my work with models is iterative, and I'd prefer it doesn't go off on a token bender just because it can.
Note: I don't have WSJ, but found these from a tweet[0]
Like brother I could have just logged in for you??