Smilinrobin

We've added Playwright's Tracing capability for debugging end to end agentic test execution by our open source testing agent: https://github.com/test-zeus-ai/testzeus-hercules/. Coupled with the capability to log thoughts and inner monologue of the agent, now our users can review the direction taken by the agent; and steer it in the right direction. Or catch hidden bugs in the application under test.

Thanks. Also, while Hercules can do Salesforce, we've also checked it for complicated scenarios on the web (and there's an eval folder too). We'd love to know about your feedback and thoughts.

In theory , yes we could, but would it yield "good enough" results for a "testing" agent- Probably not. The LLM here is actually not just responsible for tool calling, its also doing other intricate things such as planning the next steps based on the input feature file, and generating the browser/API automation code. In our experiments we found that OpenAI 4o performs best, followed by Haiku or Grok.

THanks HackerNews for not letting us update the post. But the Discord link had some bug (yes, we need more testing), so here's the link for joining our Discord server: https://discord.gg/JhSAGhfR55

1 - Yes, thats the whole idea (almost) 2 - LLM based 3 - Understands and acts on multi layered DOM 4 - Its available as a docker container. Plus we offer paid solutions for real large scale deployments 5 - Yes, planning for it. Thanks.

You can already try other LLMs. Steps in docs.

This rocks!!