Hacker News Reader

Comment by steve_musk | Hacker News Reader

I would think SC2 is harder than Dota 2. In Dota you control 5 units while SC2 you can build hundreds.

Technically, in Dota you only control 1 unit. That being said, I don't know if OpenAI's algorithm had 5 independent agents controlling 1 unit each, or 1 agent controlling 5 units.

OpenAI Five had a separate agent per unit, no explicit coordination.

This is incorrect. They shared neural net activations which is explicit communication.

I believe it's five identical agents: https://blog.openai.com/openai-five/

But because the agents were all trained together, they kind of operate as a unit.

Coordination

OpenAI Five does not contain an explicit communication channel between the heroes’ neural networks. Teamwork is controlled by a hyperparameter we dubbed “team spirit”. Team spirit ranges from 0 to 1, putting a weight on how much each of OpenAI Five’s heroes should care about its individual reward function versus the average of the team’s reward functions. We anneal its value from 0 to 1 over training.

It would be fun to see the AI players spamming the ingame chat to communicate with each other in its own language :)

A truly superb AI would guilt the support AI into buying wards by constantly whining about it in chat. It would also ping the minimap when one of its teammates makes a mistake. Finally, at the end of the match, it would pronounce "bad team" if it lost.

(I never played dota2, that's all I know about the game ;)

In the last model they trained they shared some part of a layer for all the agents. So it was like a one agent trained with shared knowledge of the rest.

at the same time that could be seen as an advantage for the machine, as multitasking is much easier for a massively parallel computer not limited by muscle movement or vision than for us. we'll see. depends on the usual stuff like limited apm ofc

I wonder if they stuck with their original game playing API that takes in some "visual" features. In that case it would be "limited" by vision.

in dota there are 10 players, so you have to coordinate. apples to apples this would mean 5 indepdendent bots per team that have to learn that. there are also summons to control and elaborate spell interactions.

Reply on news.ycombinator.com