I was gobsmacked to hear a friend say that their work guidance is to use ChatGPT to write letters to external clients for example. I know for sure I'd be insulted if someone sent me paragraphs of text to read created from a sentence long prompt. I'd rather have the prompt, my time is valuable as well.
Cue someone making some horrible error because some crucial information didn't survive ChatGPT->ChatGPT round-trip
Very soon everyone will in effect "hide" behind an agent that will take all kinds of decisions on one's behalf. Everything from writing e-mails to proposals but also to sue someone, make financial decisions, and be a filter that transforms everything going in or out.
I can't imagine this world really. How the hell are people going to compete or stand out? Doesn't it seem that what little meritocracy existed wills soon drown in noise?
The realization that individuals will also have this barrier to the world is even scarier.
If it goes that way we could be looking at a change to society on the level of social media, again. Mad.
I honestly don’t know why we’re so obsessed with having LLMs generate crap. Especially when they’re very capable of reducing, simplifying. Imagine penetrating legal texts, political bills, obtuse technical writing, academic papers and making sense of those quickly. Much more useful imo.
I'm not anti-AI; I've recommended that we use it at work a few times where it made sense and was backed by evidence/bencharmks. But for essentially any problem that comes up someone will try to solve it with ChatGPT, even if it demonstrably can't do the job. And these are not business folks, these are engineering leaders who absolutely have the capability to understand this technology.
We've found some early success selling to companies with older "long-tail" ERP's. I've been finding a new one every day.
Naively asking a chatbot to write for you does not help with this at all.
It would be interesting to try to prompt ChatGPT to ask questions to try to figure out what the user is trying to write and then to write it.