we have no way to evaluate that. OpenAI products are severely lobotomized. Microdoft fears another Tay
[1] To be fair, way to wordy and blowhardated version. Alexander seems to be getting worse and not better. The core ideas here could be presented in about a third the space.
the procedure seems more like a way to evaluate Anthropic-based AIs with different numbers of parameters, rather than a cross-the-board evaluation of fine-tuned chat AIs, and then those results are extrapolated to somehow say something about all AIs that are built similarly.
unless i'm missing some key here, it feels like a rather loose way to derive experimental data from the landscape.