tell me you've never run anything without telling me you've never run anything...
990 karma · joined September 14, 2011
tell me you've never run anything without telling me you've never run anything...
And totally agreed, both products take a slightly different approach and have different strengths and weaknesses, try them both and see which is a better fit!
What we're asking you to consider is how much of that is because the tooling is shutting out the roles who are naturally incentivized to care about product quality?
I think your broader thesis, while amusing, is ignoring some of the biggest and most valuable brands ever created... Apple, Rolex, Mercedes...
Regarding DOM interaction, you're missing the point. All automation that tests the front end code, regardless of how it attaches, is using a path that is different from your end user. The end user interacts with the application visually. That's why we test visually. A decrease in code-based brittleness is just a nice side effect. And as you note, this is a very high-level post outlining one key idea about quality ownership. You may be interested in this, which is one of our front end folks talking about why we believe testing visually is superior: https://www.rainforestqa.com/blog/the-downfall-of-dom-and-th...
We have been selling a QA solution for almost 10 years. In that time we've seen thousands of setups and directly worked with hundreds of teams. Your claim "weaknesses of automated test frameworks [...] are compensated for quite easily and routinely" is, quite simply, not true for the majority of engineering teams - few QA leaders, including proponents of Cypress, would agree with you.
Read the piece - it says no such thing. It's talking about 'ownership', which is distinct from participation and most certainly from interest.
We are to my knowledge the only product built for this kind of cross-functional ownership, that's why I don't recommend other products.
While I agree the post is too marketing-y - to be honest I didn't expect it to appeal so much to the HN audience - it was written in good faith. We built the product because after 7 years of building a product for one of those silos, we became convinced that the only long-term durable solution was to empower everyone to own quality. Clearly I need to figure out how to strike the balance that you outline in your last sentence, which was the goal!
I think the challenge is that, while we agree on the optimal setup, it's almost never done like this. There's lots of reasons why, but the main one (imo) is organizational scaling. The logic of scaling teams tends towards specialization, especially because developer time is extremely expensive.
There are many ways to address the problem of QA. From our perspective, if they don't broaden the ownership of QA from just developers or just QA engineers (which is where all the current products are targeted), they will exacerbate this specialization problem.
Regarding the incentive structure, I think you're right - there's no way to eliminate the friction that comes from competing incentives. Our experience has been that empowering the product organization to make that tradeoff themselves leads to the optimal outcome for the business. The goal isn't to eliminate the tradeoff between speed and quality, but surface it, and put it in the hands of the people who are the business decision makers, which tends to be product.
Re test data - we had seen this bottleneck with our previous product, which was purely about crowd testing. What we've seen since we shipped no code automation is that much of the data seeding by less mature teams can be done through the tests themselves. This is suboptimal, but with automation so cheap and fast, it works. Then over time the engineering team can seed the states that are most often created through the tests.
Silicon Valley is literally built on 'paying it forward'. Giving advice to others for free because that's how you got to where you are today. That's what the mentors here are doing. To feign ignorance of that, and then to wrap it up in a half-baked "bUt ItS Vc EvIL" is pretty transparent.
...coinbase was a 'no idea' startup
A few principles that may be useful:
- have a regular cadence of communicating, usually monthly, usually he last day of the month
- have a standard format and stick to it
- numbers are better than words
- preview the updates where you uncover scary stuff over the phone / in person before sending an update
- always include an ask
The hook for the founders? Who knows. My guesses:
- assumption that eventually the enterprise play will win the majority of the $ in the market
- that there is possibly a winner-takes-all dynamic in the market, given the strong ecosystem benefits
Also, it's very expensive to sell top-down to enterprises. In SaaS your cost of sale is up-front (sales salaries, commissions, acquiring the customer etc) whereas the payout is typically over time. Even if the contracts are mostly paid up front, you still have to build the enterprise sales team and ramp the reps, which can take around 6 months. So it's possible that the logical premise "pumping all this money into firms that clearly don't need such vast amounts of it" may be incorrect if enterprise sales success is required for long term success and they don't have the cash to 'go enterprise'.
Will be fascinating to see how this market plays out. My money is on Sid.