Actually, that might be a future project! I am a bit worried about how much data I'd be sending on each request and how that may eat into tokens though, especially for more troublesome issues.
Yes I'm trying to catch up with the llama crowd - I wouldn't mind giving recursive shell access to a locally hosted, offline language model. On the other hand, hooking up a networked LLM to your networked shell is essentially a RCE by design