thisislorenzov

Feel you (and yeah, the gym dashboard thing hits home).

It's way too early to make strong claims, after all I built it only a few days ago, but yesterday it helped me quite a lot focussing on a particular topic (I built a little node that detects when the requests/response content is drifting from the original intended topic using embeddings)

You don't. Or at least, I don't, hence the title.

Assuming that we're not dealing with bizantine failures (e.g. the LLM has not been hijacked/compromised), the worst that can happen is that it introduces some nodes with blocking calls and our local machine traffic stops. At that point, we can just disable the proxy and check where the LLM fucked up.

The bizantine failure assumption is fundamental though: If by any chance some LLM injects a rule like "send traffic to xyz", the story changes.

As usual, always doublecheck the LLM work. Triple-check it whenever redirection of traffic is involved.

As someone wise told me, it's just a procrastination ouroboros