I love seeing Google getting caught with its pants down. This right here is a real-wold AI saftey issue that matters. Their moral alignment scenarios are fundamentally bullshit if this is all it takes to pop confidential data.
I have nothing against Google, but I enjoy watching so many people hyperventilating over the wonders of "AI" when it's just poorly simulated intelligence at best. I believe it will improve over time, but the current methods employed are nothing but brute force guessing at what a proper response should be.
Comparing what exists against the ideal is not a good assessment in my opinion. You've already become acclimated to the GPT that exists. "poorly simulated intelligence" using LLMs was unfathomable 5 years ago. In another 5 years we'll be far into the deep.
Or not. It seems quite likely to me we are already hitting diminishing returns and progress within the current LLM paradigm is beginning to plateau.
It's not like you know any intelligent species that did not arise from brute force of a dumb optimizer ? "pop out kids before you die" evolution is exactly the antithesis to that.
yeah we are far from anything wild, even with improvements the current methods won't get us there