This might be relevant. It’s a consortium with members like Baidu, nvidia, arm etc

https://mlcommons.org/benchmarks/inference-datacenter/