Which begs the question: what happens when any key (even an invalid one) gets added to iTerm for any reason (e.g. dark pattern, settings export/import, buggy update, accident, forgetting to remove an old key, a sentinel message saying: "do not use AI in this department", etc...).
Besides that there's other issues,
- What happens if the training data is poisoned to compromise developers machines with a `curl ... | sh`?
- What about developers who can no longer use the tool due to policies/regulations that rule out products with LLM features, or a feature that has the potential to send data to a third party?
- What happens if the LLM hallucinates an env variable's value/existence and what should be a simple `rm -rf $BUILD/` turns into `rm -rf /` when $BUILD is not defined?
I'm sure there's more concerns too.