Home / Software & Service News / Apple’s AI chief describes potential for reinforcement learning

Apple’s AI chief describes potential for reinforcement learning


Artificial intelligence has made great progress in helping computers recognize images in photos and recommending products online that you’re more likely to buy. But the technology still faces many challenges, especially when it comes to computers remembering things like humans do.

On Tuesday, Apple’s director of AI research, Ruslan Salakhutdinov, discussed some of those limitations. However, he steered clear during his talk at an MIT Technology Review conference of how his secretive company incorporates AI into its products like Siri.

Salakhutdinov, who joined Apple in October, said he is particularly interested in a type of AI known as reinforcement learning, which researchers use to teach computers to repeatedly take different actions to figure out the best possible result. Google, for example, used reinforcement learning to help its computers find the best possible cooling and operating configurations in its data centers, thus making them more energy efficient.

Researchers at Carnegie Mellon, where Salakhutdinov is also an associate professor, recently used reinforcement learning to train computers to play the 1990’s era video game Doom, Salakhutdinov explained. Computers learned to quickly and accurately shoot aliens while also discovering that ducking helps with avoiding enemy fire. However, these expert Doom computer systems are not very good at remembering things like the maze’s layouts, which keeps them from planning and building strategies, he said.

Part of Salakhutdinov’s research involves creating AI-powered software that memorizes the layouts of virtual mazes in Doom and points of references in order to locate specific towers. During the game, the software first spots what’s either a red or green torch, with the color of the torch corresponding to the color of the tower it needs to locate.

Eventually, the software learned to navigate the maze to reach the correct tower. When it discovered the wrong tower, the software backtracked through the maze to find the right one. What was especially noteworthy was that the software was able to recall the color of the torch each time it spotted a tower, he explained.

However, Salakhutdinov said this type of AI software takes “a long time to train” and that it requires enormous amounts of computing power, which makes it difficult to build at large scale. “Right now it’s very brittle,” Salakhutdinov said.

Another area Salakhutdinov wants to explore is teaching AI software to learn more quickly from “few examples and few experiences.” Although he did not mention it, his idea would benefit Apple in its race to create better products in less time.

Some AI experts and analysts believe Apple’s AI technologies are inferior to competitors like Google or Microsoft because of the company’s stricter user privacy rules, which limits the amount of data it can use to train its computers. If Apple used less data for computer training, it could perhaps satisfy its privacy requirements while still improving its software as quickly as rivals.

This story originally appeared on Fortune.com. Copyright 2017

Click Here For Original Source Of The Article

About Ms. A. C. Kennedy

Ms. A. C. Kennedy
My name is Ms A C Kennedy and I am a Health practitioner and Consultant by day and a serial blogger by night. I luv family, life and learning new things. I especially luv learning how to improve my business. I also luv helping and sharing my information with others. Don't forget to ask me anything!

Check Also

Hoo-boy! This damning Uber letter is a wild ride

TwitterFacebook

The disasters that former Uber CEO Travis Kalanick left in his wake at his popular ride-hailing app company was one of this year's biggest tech industry stories. Now, as we wrap up the year, Uber (through a court case) has gifted us a letter detailing many of the company's alleged wrongdoings and spy tactics. 

The so-called Jacobs letter was written by an attorney representing Richard Jacobs, a former Uber security analyst. It alleges shady and potential illegal operations, including how Uber employees monitored the competition and acquired trade secrets. 

More about Transportation, Uber, Self Driving Cars, Waymo, and Uber Waymo

css.php