135 karma · joined July 14, 2024
In most cases, GDS now use just 3 text fields for day, month and year, but recommend pickers for dates close to today's date e.g. for booking an appointment, because a picker is easier if you don't know the exact date without reference to a calendar.
Sadly they don't currently have a recommended picker, but there's a useful discussion of what has been tried here:
https://github.com/alphagov/govuk-design-system/discussions/...
I think this use case of automation in a BPA sense is more compelling than using it for test automation, because the latter is much more concerned with the precision and repeatability of the process. For the BPA task, arguably you care only about the outcome and it often doesn't matter if it gets there via some crazy route.
Part of the problem for me is that your example video shows a big wodge of prompt that had to be written to make this work and then a few kb of payload data (parameters) in a plaintext, non-csv format. If the expectation is that this replaces someone just using Playwright with codegen due to that being too technical, I'm not convinced there is a huge group of people who can manage one task but not the other.
Furthermore, you are expecting them to pass over their website login credentials and apparently their credit card details too, in plain text. You had better have a very solid idea of how to handle that sensitive data to avoid serious consequences if your users' skyvern accounts are compromised.
I think the frequency of website redesigns is oversold by people producing these LLM-driven Playwright wrappers, especially when targeting old-fashioned or government sites. As an example, we have had a suite of lengthy Playwright browser automations to interact with a government site for a few years and have had to maintain them only once, when the agency's business process changed. The prompt would also have needed to change had we used Skyvern, as would the payload, because the process was different. The difference with the Playwright automation, though, is that we could use assertions to verify steps had succeeded/failed and data had been recorded correctly, so we would know the process needed updating. I can't see that option in Skyvern which would have me worrying that process changes would be overlooked and we would unknowingly start entering the wrong data or missing steps.
It's pretty much impossible to do any meaningful and accurate data entry while riding a bike, whether the interface is touch, voice or whatever. You need to be able to verify that the phone has accurately captured what you were trying to tell it, not just take it on faith that it's worked, and that means looking at the screen carefully. Good luck to them making this work reliably.
The Playwright dev team would probably say that you should avoid using IDs as selectors and instead favour the use of selectors based on user-visible aspects, e.g. "a link including the text 'cat'" or "a button with the label 'register now'". That way your tests are immune to under-the-hood changes the user is oblivious to. The range of selector options (locators in their world) are a real strength of Playwright.
I was thinking a possible solution would be a simple numerical counter (e.g. days since 1 Jan 2000), which can't be easily decoded by eye, but allowed you to rank items easily by age.
My question was really about the page interactions and the assertions being driven by AI: if they are going to be generating different code every time the test runs, how can you have any confidence in the test not having false positives and false negatives at least some of the time, unless you read the generated script each time?
That sounds like a lot more work than just writing the test once in the traditional way (codegen or manually) and tweaking it only when there's a breaking change to the page.
If people are genuinely using this approach then there must be something I'm missing.
I stumbled on this fantastic piece promoting the use of UTC time, but incidentally giving a great history of the standardisation of time more generally and the adoption of 24h clock notation over AM/PM.
https://en.wikisource.org/wiki/Popular_Science_Monthly/Volum...
They then force them to use each of the prescribed set of methods even when they are totally inappropriate for the task. Any deviation from the method they are told to use for that question is wrong. No creation of your own adapted methods is acceptable.
In other words, the teachers were taught that kids should use different methods, but seemingly weren't taught why.
https://github.com/nisargnp/DeadReckoning
I read a paper some time ago which suggested that mobile devices are still nowhere near good enough to use this e.g. for navigation around a shopping mall.
https://www.gov.uk/guidance/climate-change-levy-rates
This is what happens when people treat the Telegraph as news rather than a source of disinformation used by wealthy vested interests to manipulate public opinion.
Could the score be visible during the game to give a sense of the scoring rules? I didn't know the king eats pieces until I read the comments here... I would expect that to lose you points, but hard to tell unless the scoring is maybe documented somewhere I missed?
This makes sense, because they want people to be able to subscribe to their services later without having to visit the dealership, so they make it possible to remotely enable the service.
I'm not sure if you can buy a tinfoil hat for a car.
They had very rational reasons for trying to slow the introduction of a technology that was, during a period of economic downturn, destroying a source of income for huge swathes of working class people, leaving many of them in abject poverty. The beneficiaries of the technological change were primarily the holders of capital, with society at large getting some small benefit from cheaper textiles and the working classes experiencing a net loss.
If the impact of LLMs reaches a similar scale relative to today's economy, then it would be reasonable to expect to see similar patterns - unrest from those who find themselves unable to eat during the transition to the new technology, but them ultimately losing the battle and more profit flowing towards those holding the capital.
If not, you'll never unseat the seasoned professionals of the UK real estate sector ;)
Yep. A difference of a couple of percentage points even with a sample size of 20,000 is tiny. While they have taken it to mean that hybrid is "better" than in-office, I would take it to mean that they are essentially identical across the breadth of the survey.
For your particular industry or organisation there may be significant variation, but you'll need to find that out for yourself.
I think this needs more elaboration on what the Finic wrapper is adding to stock Playwright that can't just be achieved through more effective use of stock Playwright.