I'm seeing lot of negative sentiment around this on X. I think the key is to establish independence. If Accenture stems to gain (financially, in some way) from Anthropic success - for example if they rely on Mythos class models to reduce costs or generate revenue - then this will obviously not fly. Then there is a more philosophical question - can independent evaluation be established at all? Since we are all exposed to these models, and some people REALLY like Claude models.
This just seems like the most basic and obvious form of regulatory capture. Want to start an AI company? Great! Now you just need to raise an additional $50m to cover your embedded evaluator costs, with rules and processes written by Anthropic.
Embedded as in embedded in a company. It’s not referring to embeddings.