But what if emails can be mass produced at 15+ words/second, on a gaming PC?
And what if they can very convincingly and quickly reply?
And what if they can very convincingly and quickly reply?
Why would being able to write different emails help? Wouldn't they just reuse the same email over and over again, maybe just changing the addressee's name?
Also, now I wonder what the typical response rate is for phishing emails? Are they already getting too many responses to keep up with or are they already managing just fine without bots?
I think LLMs might be better for scams carried out over instant messaging services like Discord because that probably requires greater attention and flexibility on the part of the scammer.
Still, has the number of people that could conceivably be scammed over an email or instant messaging-based scam increased? That is, will LLMs, by virtue of their response quality, responsiveness, or some other salient quality, increased the pool of people who could fall for these scams? If the answer is no, then I don't see how increased scale and throughput for human-quality text generation will really matter much.
Think of it as a large scale A/B test of circumvention techniques against both human and automated scam detection systems.
Done right, it can effectively keep getting better on its own. Then add phone scamming and various other interactive scams once it is good enough. TBH, it is pretty scary where this will inevitably head.
Turn this around, and have an LLM that replies to scammers and keeps them busy.
There's already https://en.wikipedia.org/wiki/Lenny_(bot) , but this is an area where AI could actually be a useful addition.