Have you looked into supporting / documenting benchmarks with BuildKite? I’m particular they can run tests in parallel across machines.

They ask you to also host the runners.

https://buildkite.com/features