Migrated actions to a spare M2 MacBook Air at home, and when offline, uses hosted Actions as a backup. Bonus: has simulators/emulators for ease of running Maestro tests for mobile QA.
99 karma · joined August 8, 2018
Migrated actions to a spare M2 MacBook Air at home, and when offline, uses hosted Actions as a backup. Bonus: has simulators/emulators for ease of running Maestro tests for mobile QA.
Best of luck on the beta & release!
ChatGPT validates your spirals. We help you prevent them.
We're in the middle of v2 over the next few months based on everything we've learned since launching ~a year ago.
As a habitual side project guy for the longest time, it's so satisfying to finally stick to one thing and go really deep. This thread has been highly motivating.
I miss working on language learning tools. My attempts were all in the ~2024 era of LLMs.
The popular thing is now to setup loops (eg I setup hourly integrations for Claude/Codex to 1) scrape my Linear, claim achievable tasks, and push PRs or 2) do root cause analysis on customer issues that evaded automated filters, to name a few)
Though for me, my setup still feels mundane. I have AGENTS.md, CLAUDE.md etc and a few skill files. These are purposefully light - tons of examples online you can pull from online. Mine are fairly personal to my setup and products.
Importantly, I also allow Claude and Codex to bypass permissions. Yes, there is a risk they wipe my machine. The productivity upside has been worth it, for me (haven't been burned yet, ~9+ months into running models this way, I have backups, use cloud etc).
As far as maintaining quality, one of the most helpful guardrails over the past year, for me, has been requiring my agents to pipe their changes to local reviewers through OpenCode, Cursor, etc agents to have a council of models with different biases reviewing the changes, and autonomously working towards a completed objective. No matter how good Claude or Codex gets, for example, I will probably always want a different model checking its work. Like GLM, (now with 4.5) Grok, Composer.
Several OpenAI, Anthropic, xAI employees, and popular AI engineers post on X and share helpful tips & updates. Highly recommend for keeping a pulse on startups and AI. I haven't found something close, honestly, other than when I spend time in SF talking to people.
Now we take for granted that the latest models can juggle between multiple browser tabs, applications, databases, simulators, docker etc to write, execute, e2e test and deploy full-stack applications over hours managing up to dozens of subagents, relatively untouched, without taking down prod even 1% of the time
Not only this, but in the GPT 5.0 era, agents had 0 taste. Nothing looked good. It was the agentic version of the twitter bootstrap era, but worse somehow. Now, I would argue the average agent frontend beats the average human frontend. This isn't even getting into 3D applications in the GPT 5 era
Anyway, the models now reliably execute more than a human can fit into their own context. It's magic
Admittedly, I was already using Codex a bit like Claude Cowork. I'm just surprised they decided to merge threads.
As their models get more competitive I'm sure prices will catch up.
No longer feels as inexpensive. Will likely just include this in the rolodex of <200k context tasks, like being one of my review agents.
Seems like we're seeing margin get eaten up by companies upstream of the buildout, and the costs have not been fully passed downstream yet. Eg most consumers still get free/cheap AI.
It'll take a few years to see what happens at scale when prices go up and purchasing behavior changes. Hardware, services etc all downstream of the buildout and supply constraints.
Kicking the can down the road for now.
But I'm a human - I will miss things. I maintain too many apps to have entire codebases in memory at this point. Or to continue monitoring all these streams. Logging is cheap - I log as much as possible because an AI will scan it for me.
I just want scoped pull requests to review proactively against the slew of things that can happen in prod that I didn't account for in my specs (again, from logs, customer issues, etc). I discard most of them. That is fine.
AI is incredible at finding patterns in otherwise benign stdouts, let alone as it cross-references data streams.
In theory, I don't need most of these automations. But for $200/mo? I will happily reduce my cognitive burden on stuff that doesn't impact the core business and make it easier to keep things gliding smoothly.
When the subsidized plans disappear, I will keep these automations going with the best small models that fit on my laptop.
I have hourly automations for root cause analysis on customer support issues, daily automations for eg log analysis, weekly & monthly automations for KPI tracking & actioning.
I will say, when I was building side projects that were 1) fairly well defined in scope and 2) without users/need for automations it was much easier to stay under $20/mo plan limits. Now I regularly hit weekly limits and need multiple Max plans
Others, especially startups or indie hackers, use AI like it were their end-all be-all assistant. "Hey Jeeves, go add Apple Sign In, Google Sign In to our signup pages. Also, investigate why we're not utilizing cached inputs on our AI APIs correctly. And add Maestro flows for every screen in our app. Btw check out posthog, supabase, and Stripe - is our new agent changing engagement or trial->paid conversion rates?"
And 3 hours later, you have all these done. But only if you use the right multi trillion param models.
The ensuing several months were some of the worst in my life (many confounding variables) missing coffee, feeling anhedonic, and inadequately caffeinated/lucid to tackle my problems.