Home / Software & Service News / Humans can help AI learn games more quickly

Humans can help AI learn games more quickly

Google taught DeepMind to play Atari games all on its own, but letting humans help may be faster, according to researchers from Microsoft and Germany. They invited folks of varying skills to play five Atari 2600 titles: Ms. Pac-Man, Space Invaders, Video Pinball, Q*Bert and Montezuma’s Revenge. After watching 45 hours of human gameplay, the algorithm could beat its mentors at pinball, though it struggled at Montezuma’s revenge — just as Deepmind did.

Unlike with DeepMind’s trial-and-error methods (below), however, the human-aided AI learned to play the games in less time than other AI systems. “Current state-of-the-art approaches require millions of training samples,” the paper states. “A promising way to tackle this problem is to augment [deep learning] from human demonstrations.”

The researchers trained the AI using “Javatari,” an Atari 2600 emulator coded in Javascript that works on any browser. They then opened it up to anyone to try, recording actions taken at each time step along with the reward earned. To further motivate players, they showed them how their average scores compared against other humans as well as Google’s DeepMind system from 2015.

In the end, the study collected 45 hours of 60 fps gameplay, around 9.7 million frames in all. After crunching that data, the machine could beat humans at pinball and match them at Q*Bert and Space Invaders, though it was overmatched in both Ms. Pac-Man and Montezuma’s Revenge.

The team acknowledges that the latter, more strategy-oriented titles are still giving the machine fits. However, it found that recording the feats of better players gives better results, so it’s using that data to tweak the next round of research. “The most important development of the dataset is to collect more data from professional players who achieve higher scores,” the researchers explain. If you want to do your own study, the massive 12.5 GB dataset is available for anyone to use.

Via: Geek.com

Source: Atari Grand Challenge, Arxiv

Click Here For Original Source Of The Article

About Ms. A. C. Kennedy

Ms. A. C. Kennedy
My name is Ms A C Kennedy and I am a Health practitioner and Consultant by day and a serial blogger by night. I luv family, life and learning new things. I especially luv learning how to improve my business. I also luv helping and sharing my information with others. Don't forget to ask me anything!

Check Also

AI Everywhere: Surprising ways we already interact with artificial intelligence


Paid Content by


If someone were to say to you that you’ve spent all day interacting with artificial intelligence, you’d probably stop and try to recount any instances of accidentally running into a robot

Despite what’s constantly being hammered into our brains via science fiction movies and television, AI comes in many forms, which may surprise you. Not only has artificial intelligence become integrated within a number of industries, but it’s teaching people how to streamline business and optimize their lives.

From social media to public service, some people are interacting with artificial intelligence every single day and it may surprise you how broadly it is being adopted. Here are some ways we’re already using AI on the daily.  Read more...

More about Supported, Artificial Intelligence, Chatbot, Deep Learning, and Virtual Assisstant