People, in general, are stupid (me included). Do we do stupid stuff? Every fu*ing day! And then again!
Prompt injection is more like a "cheat" code - yeah, you can "noclip" through walls, but you're not going to get the ESL championship.
Prompt injection is more like a "cheat" code - yeah, you can "noclip" through walls, but you're not going to get the ESL championship.
I don't understand what you mean by this. LLMs are literally being wired into military applications right now. They're being wired into workflows where if something falls over and goes terribly wrong, people actually die.
If somebody hacks a Twitch bot, who cares? The problem is people are building stuff that's a lot more powerful than Twitch bots.
Do you have any proof to back this claim?
What do you think happens if that AI starts lying about what units are available or starts returning bad data? Palantir also mentions wiring this into autonomous workflows. What happens when someone prompt injects a military AI that's capable of executing workflows autonomously?
This is kind of a weird comment to be honest. I want to make sure I understand, is your assertion that prompt injection isn't a big deal because no one will wire an LLM into a serious application? Because I feel like even cursory browsing on HN right now should be enough to prove that tech companies are looking into using LLMs as autonomous agents.
Of course the application-infrastructure might be vulnerable as well in case the user IS the attacker, but it's more difficult to imagine concrete examples at this point, at least for me.