Hacker News Reader

Comment by zhobbs | Hacker News Reader

Technically, in Dota you only control 1 unit. That being said, I don't know if OpenAI's algorithm had 5 independent agents controlling 1 unit each, or 1 agent controlling 5 units.

View on HN

I believe it's five identical agents: https://blog.openai.com/openai-five/

But because the agents were all trained together, they kind of operate as a unit.

Coordination

OpenAI Five does not contain an explicit communication channel between the heroes’ neural networks. Teamwork is controlled by a hyperparameter we dubbed “team spirit”. Team spirit ranges from 0 to 1, putting a weight on how much each of OpenAI Five’s heroes should care about its individual reward function versus the average of the team’s reward functions. We anneal its value from 0 to 1 over training.

It would be fun to see the AI players spamming the ingame chat to communicate with each other in its own language :)

A truly superb AI would guilt the support AI into buying wards by constantly whining about it in chat. It would also ping the minimap when one of its teammates makes a mistake. Finally, at the end of the match, it would pronounce "bad team" if it lost.

(I never played dota2, that's all I know about the game ;)

In the last model they trained they shared some part of a layer for all the agents. So it was like a one agent trained with shared knowledge of the rest.

OpenAI Five had a separate agent per unit, no explicit coordination.

This is incorrect. They shared neural net activations which is explicit communication.

Reply on news.ycombinator.com