I’d be curious to hear about the comparison to https://reflect.run — I can imagine that access to the tester community is a piece of that…
I’d be curious to hear about the comparison to https://reflect.run — I can imagine that access to the tester community is a piece of that…
Outwardly, the way they automate is very similar to us. Looking a little deeper, it seems like they _do_ use the DOM pretty heavily (from re watching the video at https://reflect.run). For us, this is a fundamental difference - we do not believe in this; we want to automate testing-like-humans. It's harder, but we believe replicating how a human would detect things working or not (visually, via kvm) ends up with less brittle, easier to maintain tests that are closer to the reality of how a human would interact with your app.
Also, we test using VMs (or physical devices if needed for mobile) - allowing us to test the browser, or any other kind of software. This lets us support a large combination of OS and browser variants out of the box, or custom images for enterprise. Reflect doesn't seem to support more than Chrome when I last looked.
The workflow for creating tests in Reflect is pretty similar to Rainforest: we both expose a "cloud browser" that loads up your webapp and you interact with that to create your tests. The biggest difference workflow-wise is that Reflect records all your actions automatically, whereas with Rainforest you often need to both specify what step you're going to take, and then actually perform that action in the browser itself. Recording everything automatically is technically harder to pull off since it's forced us to ensure we accurately record every step you take, but we think it makes for a better workflow since you can create tests faster, and there's less chance of inaccuracies that cause tests to not be repeatable.
I would quibble with the statement that you need to be far more technical to use Reflect - we're a no-code product after all. :) We have plenty of folks who aren't developers using our product. But the good thing is that both products have free tiers, so users can always give us both a try for free and decide for themselves.
Edit: Also their statement about Reflect running in headless mode is incorrect. Our test grid is a cluster of VMs: we spin up a Docker container for each test run, and each Docker container is running the test steps using a normal non-headless browser.
And totally agreed, both products take a slightly different approach and have different strengths and weaknesses, try them both and see which is a better fit!
So, we went the route of having the same way of doing things for everything. We may change this in the future, but at the moment it's consistent and easy to learn. You add an action, then run it - no need to do it twice, or learn multiple ways of doing things.