can't be sure the development continues. As much as opus got better at programming the less I understand the output. it keeps inventing terms and skipping steps for the reader to understand what is written properly.
I also feel like progress in programming is becoming a lot slower now.
didn't they also claim this about gpt-2? for sure there is a lot of PR involved as well. Models can also be both, really good at cyber security and bad at writing emails.
I wonder what happens if you prompt it to be a tool and not an assistant and that it does not need to be helpful just do as instructed or something like this
I'm always impressed how fast people get used to new things. couple of years ago something like chatgpt was completely impossible, and now people complain it something's does mit do what you told it to and sometimes lies. (not saying your points are not valid or you should not raise them)
Some of the points are just not fixable at this point due to tech limitations. A language model currently simply has no way to give an estimate of its confidence. Also there is no way to completely do away with hallucinations (lies). there need to be some more fundamental improvements for this to work reliably.
pytorch, tensorflow, numpy there are quite a few examples ai/ml has been steadily more commodetized, so it's far from only being developed by mathematicians. Hence every highschools student and his mother has an AI startup now. (And I'm not even mad, it's actually very exciting to see what people come up with nowadays)
it even goes beyond trump unfortunately. how can others be sure that we won't someone like him again or worse in 8 years from now. Our system does not have safeguards against lunatics like him I would not trust the US either if I were from some other country.