Learning more about how an LLM's output can be manipulated, because one is interested in executing such manipulation and/or because one is interested in preventing such manipulation.

It sounds like you're reflexively defending the system for some reason. There are endless reasons to learn how to break things and it's a very strange question to pose on a forum who's eponym is centered around this exact subject. This is hacking at its core.