Someone writes these things. They are influenced by lobby, yes, but even lobbies, think tanks and such generally draw their ideas from what's lurking around in their vicinity.
There are no secret "geniuses of working out how this should work." That is what it is, and it shouldn't surprise anyone.
The public sphere is not good at producing politically practical suggestions either. It's good to talking s** and offering charismatic partial answers, speaking for some specific interest or opinion. Barely better than the lobbies, sometimes worse.
But does it apply to legislating? One drawback might be that political will and attention is fleeting; and interests become vested in a current state, blocking change; and it's now or not for another generation or so.
If we want to have good regulations and effective regulatory agencies, we should be judicious and methodical about what regulations are adopted, who is granted enforcement authority, and what that authority consists of.
It's mostly circular reasoning: Why is it more important? Because we should have a high index of suscipicion, because it's more important.
I think we should be equally suspect of people pushing against regulation, which also empowers the powerful.
If a problem, like tracking what non SOTA models are doing with respect to safety, don't rise to being worth regulated, then why bother regulating it? If you're going to force everyone in the field, in California, to file additional paperwork (and understand what they're legally supposed to report and how and when), then you probably should have a compelling argument for why. If you didn't do that now, and it's never a big enough problem to regulate then you've done no real harm. If it's clearly an issue that needs to be regulated in the future then it should be easy to do so.
That hasn't really been the case, though. Lots of things have needed regulation for a long time - look at carbon emissions, for example - and it doesn't happen.
Perhaps the solution is to create the regulatory agency and give them a legitimate process to create new regulations as needs change. Legislatures have limited time and expertise, and can't possibly keep up anyway.
I also came here to comment on my concern about this. Only big players with significant legal resources like Google/Microsoft are going to be able to compete once you let this element start to creep in.
Some of these people are directly employed by the government, others are tied to (government funded) non-profits. They may have good intentions, but it is the end results that matter. Ultimately, they will not speak against the self-interest of their own group.
From the standpoint of software development, think of it as a codebase you can't refactor but has an endless stream of new business logic which may or may not conform well with the database structure. Eventually it just stops working.
To speak about Google/Microsoft/Big Tech in particular, it isn't just legal resources - it is overall resources. Doing basic things get a lot more expensive and slow.