GPT3/DALL-E2 in Discord, chat like ChatGPT, generate images, and more
github.com
github.com
You’ll just expect that most of the users on discord are bots unless you know them irl.
Every year the cost of training these models drops so they won't be out of reach for long.
Now we're coming to an Eternal (AI) Winter..
Spooky to think about, but you could be right. :-/
How can HN and its open registration survive?
Maybe if all you ever exchanged with someone was a few sentences about inconsequential stuff. ChatGPT isn't even close to being able to consistently act like a single human being with interests, plenty of long term memory, and a life outside a chat room.
Right now the performance of ChatGPT in your average discord chat room would be absolutely awful. Nobody is bothering to write their messages as proper prompts a state-of-the-art AI could understand. People don't even just talk about one thing at a time - having multiple threads of conversation interspersed with each other is quite common and would absolutely confuse any current AI. There's also in-jokes and subtle references to things said days ago. People try to only use minimal information to convey what they mean, and often make figuring that out a small puzzle/joke to keep the conversation interesting.
Is it really not close, or just not done yet? They're already using human feedback loops to get it as good as it is generally, is it a huge step to then allow personalised feedback loops so that the local instance remembers its own "personality"? (I'm not an expert so maybe that is a huge, unrelated leap in a way that I can't see?)
I think we need LLMs capable of reading a whole book at once, about 100K tokens. I hope they can innovate the memory system of transformers a bit, there are ideas and papers, but they don't seem to get attention.
What about Open.ChatGPT in mid 2024?
Since 2017 there have been hundreds of attempts to bring O(N^2) to O(N), but none of them replaced the vanilla attention yet in large models. They lose on accuracy. Maybe Flash attention has a shot (https://arxiv.org/abs/2205.14135).
Not unlike a person that wrote newspaper articles all his life and now has to use discord.
If you trained it on discord messages it would probably be indistinguishable from most discord users.
You might get an average of all discord users, or all discord users at once. Neither would seem like a real person.
For instance someone who is interested in and capable of talking about any topic will not look real. A normal discord user will not contribute to conversations they don't care about or know nothing about.
AFAIR discord requires phone number, and that's the main reason spam isn't a problem, so maybe we're already there.
In such a place it doesn't really matter whether anyone is real, does it? You're probably there to get a few laughs or something, not build relationships with people.
Though there's more serious places with real people. Off the top of my head there's two large discord servers I'm active in: One is to find people to play a certain video game with, the other is a community of developers who use somewhat niche technology and probe each other's brains for knowledge that often can't be found on the internet. In either community a chat bot would be immediately obvious.
Then there are 1000+ users open servers - usually for developing some open source projects or talking about $RANDOM_HOBBY. These would definitely be affected if not for the requirement of giving your phone number to access discord.
You can imagine the problems that 1000 bots posting proceduraly generated bug reports could cause :)
Like usually on HN, you give humans too much credit. Most people never exchange anything else with anyone but inconsequential stuff. IRL and online. The AI will give itself away by being too eager to write content and too grammatically/semantically correct and not random and inconsistent enough.
Go to some places (instagram is pretty good for that) where people basically only communicate in emoji's and memes and where every sentence longer than 4 words is misunderstood because no-one actually has reading comprehension.
> Right now the performance of ChatGPT in your average discord chat room would be absolutely awful.
Most of the internet, including many discord channels are already absolutely awful.
So yeah, it is a problem; for me, most people responding outside a few discord channels, subreddits, lobsters and hn, it's already bots or humans that could as well be bots anyway. And only a matter of time before it takes over those few places that are still ok.
I will probably move to meetups offline more and more. The opposite of what I did my whole life.
If my interaction with them is that shallow, does it matter if they are real or a bot?
The problem is when AIs become such high quality that they can influence people’s minds and behaviours through psychological tricks. This is also already happening but mostly humans are creating that content which is upvoted and responded to by their bots.
This is going to be AI soon-ish and that is a problem imho. But not something we will be able to do much about except KYC people as rigoureus as banks do (bye bye privacy, unless this is implemented well) or making them pay to post. Both won’t kill all bots, but will shrink the reach of them as suddenly it’s a very costly affair to do at scale (buying real people and paying to post).
Wait until GPT4 comes out next year...
Thinking of online reviews etc. where you don't have a proper log and can't follow a user properly.
They are really bad as is, but they could be made completely useless in a millisecond. Even proper reviews with images etc could be absolutely trivial to make and for $10 you could automatically generate rave reviews for your product and trash any number of your competitors.
We will probably need to identify users somehow, which will only serve the centralized FAANG version of internet that at least I despise.
I (EU member) already have an ID card and a government issued electronic signature, perhaps a service like reddit could just ask me to sign something to verify that I'm a real and unique human being.
Of course there are all kinds of risks of people being hacked, no throwaways, leaked signatures being traded, government refusing to issue IDs to whistleblowers on the run, and so on.
Too long already has been the struggle to distinguish the phraseologists from those who think. Finally here is the societal pressure to develop means to distinguish what brings progress from all the semantic sugar that merely brings feel-good.
- the value of real face 2 face interaction for both business and personal life will go up again.
- We will see more of twitter's pay to participate models as an attempt to verify real human beings.
- Online advertising will waste trillions of dollars and be late to realize they are selling to bots.
I can't wait. I think we may see what Vernor Vinge envisioned - that we'll use AI-ish tech on our own computers to mediate between the massive flow of information on the internet and ourselves.
The conversation functionality also has medium term memory, and you can chat with it infinitely without having to worry about context/token limits. Moreover, in the next few days, I will be implementing long term and permanent memory for the bot using embeddings!
I think ChatGPT is a different model from GPT-3, which you are using.
From https://openai.com/blog/chatgpt/:
> ChatGPT is fine-tuned from a model in the GPT-3.5 series
Not sure if ChatGPT has some additional fine-tunings as you can get similar response using text-davinci-003, with the Chat prompt, and a temperature setting between 0.3 and 0.7.
It's definitely not the same model but similar in a lot of ways as far as I can tell. You could also try code-davinci-002 if that's what you are doing.
Even if that last 10% takes three years, that's still a terrifying prospect and a breakneck pace.
May I ask why you suggest this? I presume it's because it's simpler to tell users to just use a password, but that's also a pretty bad idea given that you're not even saying to use a secure password.