Their plan is to offer hosted products, as described in their current job openings:
https://jobs.ashbyhq.com/astral/a357ab40-9da5-4474-acc7-5888...
We'll see if that works out for them, but I also worked with their founder Charlie previously at Khan Academy, and I trust he sincerely wants to make that work.
That makes sense, that they're bottle-necked elsewhere as well.
For my current CI runs on Microsoft sample repos, mypy and Playwright are the two big time-takers, and since I run the CI on a matrix of Python versions, OSes, and Node versions, I do want it to be quite fast. You can see the timing here:
https://github.com/Azure-Samples/azure-search-openai-demo/ac...