We need equivalent of SAE J3016 levels for coding automation
The current landscape is filled with ambiguous claims. We often hear statements like "I built this with AI in one day," only to discover upon deeper inquiry that the project relied on pre-existing frameworks or skeletons, with AI merely implementing specific components through iterative conversations. This ambiguity highlights the critical need to distinguish between "AI-assisted" development and true "AI autonomy" in product creation and code generation. Many startups boast that their AI can produce projects from scratch, but it's challenging to gauge the actual level of human engagement required at first glance.
A standardized classification system would bring much-needed clarity, allowing us to:
- Accurately assess AI's role in development processes - Compare different AI coding tools on an equal footing - Set realistic expectations for AI capabilities in software development - Foster more transparent communication about AI's involvement in projects
By establishing clear definitions and levels of AI involvement in coding, we can better navigate the rapidly evolving landscape of AI-powered software development and make more informed decisions about tool adoption and project planning.
1) https://www.sae.org/blog/sae-j3016-update