Perhaps you don't really want to consider it seriously but here is my response.
>"random claims"
You don't explain how they are random, I think they are true.
> [They will not act safely unless they are able to collude with other firms to set production quotas.] "And? Neither will OpenAI, nor will any of the major players."
They should act safely. I think it is important to act safely at all times. That is based on the notion of being responsible for one's own actions, regardless of the actions of others. It does not follow from the fact that there is a bandwagon, that joining the bandwagon is the right thing to do.
Example: "It was right to steal from the shop, because everyone else was stealing."
This is clearly non sequitur.
Something else must be imported and in Anthropic's case it is just consequentialism, which states that if they develop AI in an unsafe way and take the lead, it will be a lesser evil than another firm taking the lead.
Unfortunately, consequentialism is illegal in the USA. It is not permissible to risk the lives of others because you think it will be best for everyone. That stems from a reading of human rights to life that can't be willed away by appealing to the consequences, it is the law that Anthropic does not have the authority to impose these risks on others.
The US Government sometimes acts in a consequentialist way, for example shooting down hijacked airplanes. That is mostly because it has authority grounded (in theory) in a mandate from the people such that it makes exceptions to the law. Anthropic has ZERO authority to make these exceptions.
"Hell, there isn't even much legal precedent on what "safely" even is here."
They can develop it safely. If they can't work it out, they can just stop developing it completely. The only cost to them is personal profit and gain.
"This is not a cartel, it's asking the government to make a set of laws and rules for everyone to play under otherwise the entire system ends up being a race to danger.
By definition, coordinated slowing down is a cartel.
"The people in Anthropic were thinking about AI safety when you were still in diapers."
Again non sequitur. If Anthropic has been thinking about this for longer this simply does not show that they are more correct.
"Not everything is a vast conspiracy."
This is also non sequitur. If not everything is a conspiracy, this does not show that what I am saying is wrong.