Show HN: E2E testing is a chore. We taught an AI to do it instead | Hacker News Reader

Show HN: E2E testing is a chore. We taught an AI to do it instead

playmatic.ai

Hey Hacker News,

For the last 2 months, I've been working on a testing agent to free developers from the endless maintenance of end-to-end tests.

You just push up a PR, and our agent analyzes the code changes and automatically visits the preview to test things out like a real human!

We also support describing tests in English (or even in the PR description), and we'll go through your site whenever you want via a GitHub action to test and make sure various core flows continue to work as expected.

We are looking for early testers and are giving out a generous free tier! Just sign up on the landing page.

Open articleView on HN

Did it tell you that your embedded video seems to be struggling to buffer content? How about that there isn't a way to seek to where I was in that video after it failed to resume playing and I had to refresh the page?

Did it tell you that it's weird the section headers on the homepage look like buttons? Or that it's also weird they are smaller than the text below them?

Did it tell you about the invisible footer links that were already mentioned?

Hmm, the video loads fine for me. Good call on the seeker, that's something we can add.

In general, our agent today is unlikely to call out on stylistic choices, but rather more so if something is broken. For e.g., the video doesn't start / the link doesn't go anywhere, etc.

everything you mention are good points though, and we've made a note!

This is why E2E testing isn't a waste of time. I used your homepage like a user would for a few moments and provided value.

Very cool I must say - E2E tests are such a pain, and this feels like a great way to automate the worst parts out. Signed up!!

Thanks! What're the biggest pain points that you have today?

This is awesome - ui testing is quite annoying. Are we able to see a video of what's being tested?

Yeap, you get a live feed into what the agent is doing

How long do tests take. Also your footer has invisible links

Depends on the PR / test ask. From our internal usage, most tests take around 5 - 15 mins.

Also noted on the invisible links, will get it fixed!

Reply on news.ycombinator.com