LMarena, now https://arena.ai. Not sure if they have API access to automate it though.