Humans grab victory in first of three Dota 2 matches against OpenAI

Humans grab victory in first of three Dota 2 matches against OpenAI

August 23, 2018 0 By Nazmul Khan


Artificial intelligence has swept the board with humans in games like chess and Go, but taking on e-sports might be a step too far — for now. At The International tournament last night in Vancouver, a team of human pro gamers defeated a team of AI bots at the battle arena game Dota 2. The victory for team human was decisive but by no means inevitable, with the AI players putting up a valiant fight. And with two more games to play this week, machine might yet triumph over humanity.

The bots were the creation of OpenAI, a non-profit research lab founded by tech luminaries such as SpaceX CEO Elon Musk. The lab’s main goal is to develop artificial intelligence that “benefits all of humanity,” but teaching bots to play Dota has been an important research task for some time now. Playing video games may seem trivial, but it’s a huge challenge for AI, requiring teamwork, long-term strategy, and complex decision-making. The hope is that these skills, once honed in video games, can be applied to real-life challenges.

In last night’s match, though, AI could not quite muster the goods. The two teams swung back and forth in the early stages of the game, with humans taking the lead, then AI, then humans. But ultimately, it was human strategy that carried the day.

The bot team, dubbed OpenAI Five, played well but made some key mistakes, including an unusual fixation with a neutral character in the game known as Roshan. This character lives in the middle of the map, and heroes can team up to kill it as a side-quest. Doing so is dangerous but brings serious rewards, including an item that allows heroes to respawn quickly. OpenAI repeatedly targeted Roshan, a tactic that sometimes paid off (giving key heroes extra lives), but other times left their home territory undefended, giving the humans — a team of pro gamers from South America named Pain Gaming — a chance to dig in.


A team of AI-controlled heroes take on Roshan. (Screenshot not from last night’s game.)
Credit: OpenAI

This isn’t to say that the bots showed no strategic thinking at all. Far from it. They often made decisive plays, like sacrificing isolated heroes that a human team might have tried (and failed) to save. They also played an incredibly tight game at close quarters, with precision attacks in the heat of battle. As AI games researcher Mike Cook commented on Twitter: “The bots are still very good at moment-to-moment, but they seem bad on macro-level decisions.” (For a detailed blow-by-blow account of the match, it’s worth reading all of Cook’s tweets.)

This is as you might expect. The AI system, after all, plays like a machine. It doesn’t get flustered and it has access to the game’s back-end, giving it a precise feed of numbers covering information like the health of each hero and distance between them.

The humans’ victory wasn’t a complete surprise either. Although OpenAI’s bots have previously beaten top pros in 1v1 matches and teams of skilled amateurs in 5v5 matches, these were comparatively simpler games. A 1v1 match emphasizes skills where AI excels (like precision timing), and the 5v5 matches were played with more restrictions. Dota 2 has a number of complex mechanics, including a huge roster of characters to choose from, each with their own skill-set, and in-game systems such as couriers (NPCs which deliver items like health potions) which add to the strategy. In earlier games, OpenAI removed lots of these elements, but in the matches at The International this week it’s adding some back in, increasing the game’s difficulty.

Speaking to The Verge ahead of the game last night, OpenAI co-founder and chief researcher Greg Brockman said that an internal poll of employees had suggested there was “less than a 50 percent probability of winning.” “That was the general consensus,” said Brockman, before adding that what was really important was the rate that the AI team was improving. “Usually we start playing teams when we’re about at their level, then a week or two later we surpass them. And that has happened to us a number of times now.”

So the question is now, can OpenAI Five learn from this experience and champion in the two games to come? Can they adapt and overcome? Just imagine the pep-talk those bots are getting in their AI locker room. “They’re only flesh and blood.”





Source link