I've seen many people using LLM autohackers.

Basically provide a system interpreter for LLM to run all hack functions on and off you go.