Home / Software & Service News / Humans can help AI learn games more quickly

Humans can help AI learn games more quickly

Google taught DeepMind to play Atari games all on its own, but letting humans help may be faster, according to researchers from Microsoft and Germany. They invited folks of varying skills to play five Atari 2600 titles: Ms. Pac-Man, Space Invaders, Video Pinball, Q*Bert and Montezuma’s Revenge. After watching 45 hours of human gameplay, the algorithm could beat its mentors at pinball, though it struggled at Montezuma’s revenge — just as Deepmind did.

Unlike with DeepMind’s trial-and-error methods (below), however, the human-aided AI learned to play the games in less time than other AI systems. “Current state-of-the-art approaches require millions of training samples,” the paper states. “A promising way to tackle this problem is to augment [deep learning] from human demonstrations.”

The researchers trained the AI using “Javatari,” an Atari 2600 emulator coded in Javascript that works on any browser. They then opened it up to anyone to try, recording actions taken at each time step along with the reward earned. To further motivate players, they showed them how their average scores compared against other humans as well as Google’s DeepMind system from 2015.

In the end, the study collected 45 hours of 60 fps gameplay, around 9.7 million frames in all. After crunching that data, the machine could beat humans at pinball and match them at Q*Bert and Space Invaders, though it was overmatched in both Ms. Pac-Man and Montezuma’s Revenge.

The team acknowledges that the latter, more strategy-oriented titles are still giving the machine fits. However, it found that recording the feats of better players gives better results, so it’s using that data to tweak the next round of research. “The most important development of the dataset is to collect more data from professional players who achieve higher scores,” the researchers explain. If you want to do your own study, the massive 12.5 GB dataset is available for anyone to use.

Via: Geek.com

Source: Atari Grand Challenge, Arxiv

Click Here For Original Source Of The Article

About Ms. A. C. Kennedy

Ms. A. C. Kennedy
My name is Ms A C Kennedy and I am a Health practitioner and Consultant by day and a serial blogger by night. I luv family, life and learning new things. I especially luv learning how to improve my business. I also luv helping and sharing my information with others. Don't forget to ask me anything!

Check Also

UK drone rules will require you to take safety tests

UK drone rules will require you to take safety tests

US officials might be easing up on drone regulations, but their UK counterparts are pushing forward. The British government has instituted rules that require you to not only register any robotic aircraft weighing over 250g (0.55lbs), but to take a "safety awareness" test to prove you understand the drone code. Regulators hope that this will lead to fewer drones flying over airports and otherwise causing havoc in British skies. Not that they're taking any chances -- the UK is also planning wider use of geofencing to prevent drones from flying into dangerous airspace.

The new rules come following a study highlighting the dangers of wayward drones. A smaller drone isn't necessarily safer than its larger alternatives, for example -- many of those more compact models have exposed rotors that can do a lot of damage. A drone weighing around 400 g (0.88lbs) can crack the windscreen of a helicopter, while all but the heaviest drones will have trouble cracking the windscreen of an airliner (and then only at speeds you'd expect beyond the airport). While you might not cause as much chaos as some have feared, you could still create a disaster using a compact drone.

It's nothing new to register drones, of course, and it doesn't appear to have dampened enthusiasm in the US. The test adds a wrinkle, though: how willing are you to buy a drone if you know you'll have to take a quiz? The test likely won't slow sales too much, if at all, but it could give people one more reason to pause before buying a drone on impulse. Manufacturers appear to be in favor of the new rulebook, at any rate -- DJI tells the BBC that the UK is striving for a "reasonable" solution that balances safety with a recognition of the advantages that drones can bring to public life.

Source: Gov.uk (1), (2)