This article is from the source 'guardian' and was first published or seen on . It last changed over 40 days ago and won't be checked again for changes.
You can find the current article at its original source at https://www.theguardian.com/technology/2018/may/09/googles-ai-program-deepmind-learns-human-navigation-skills
The article has changed 5 times. There is an RSS feed of changes available.
| Version 1 | Version 2 |
|---|---|
| Google DeepMind's AI program learns human navigation skills | Google DeepMind's AI program learns human navigation skills |
| (about 2 months later) | |
| Notch up another win for the robots: the latest program from Google’s artificial intelligence group, DeepMind, has trounced experts at a maze game after it learned to find its way around like a human. | Notch up another win for the robots: the latest program from Google’s artificial intelligence group, DeepMind, has trounced experts at a maze game after it learned to find its way around like a human. |
| Scientists noticed that when they trained the AI to move through a landscape, it spontaneously developed electrical activity akin to that seen in the specialised brain cells that underpin human navigational skills. So-called ‘grid cells’ were only identified in animals in 2005 in work that earned researchers a Nobel prize. | Scientists noticed that when they trained the AI to move through a landscape, it spontaneously developed electrical activity akin to that seen in the specialised brain cells that underpin human navigational skills. So-called ‘grid cells’ were only identified in animals in 2005 in work that earned researchers a Nobel prize. |
| The latest breakthrough reveals the potential for human brain-like activity to emerge from scratch in AI systems. Beyond making smarter programs, it paves the way for computer engineers to build models that help neuroscientists better understand the human brain. | The latest breakthrough reveals the potential for human brain-like activity to emerge from scratch in AI systems. Beyond making smarter programs, it paves the way for computer engineers to build models that help neuroscientists better understand the human brain. |
| After discovering the AI-made grid cells, the DeepMind researchers made a beefed-up version of the program. It went on to beat experienced players at a game that involved racing through rooms to find a prize after being dropped into the virtual environment at a random location. Equipped with the artificial grid cells, the AI was faster and found shortcuts that would occasionally crop up when doors in the environment suddenly opened. | After discovering the AI-made grid cells, the DeepMind researchers made a beefed-up version of the program. It went on to beat experienced players at a game that involved racing through rooms to find a prize after being dropped into the virtual environment at a random location. Equipped with the artificial grid cells, the AI was faster and found shortcuts that would occasionally crop up when doors in the environment suddenly opened. |
| “It is doing the kinds of things that animals do and that is to take direct routes wherever possible and shortcuts when they are available,” said Dharshan Kumaran, a senior researcher at DeepMind. “With the grid cells, its performance is markedly enhanced to the point that it surpasses an expert human player.” | “It is doing the kinds of things that animals do and that is to take direct routes wherever possible and shortcuts when they are available,” said Dharshan Kumaran, a senior researcher at DeepMind. “With the grid cells, its performance is markedly enhanced to the point that it surpasses an expert human player.” |
| The feat marks a milestone in the field of artificial intelligence. Until now the technology used has proved itself to be superhuman at object recognition and games such as chess, Go, and poker, but not at the very different cognitive challenge of efficient navigation. | The feat marks a milestone in the field of artificial intelligence. Until now the technology used has proved itself to be superhuman at object recognition and games such as chess, Go, and poker, but not at the very different cognitive challenge of efficient navigation. |
| But the research opens up fresh possibilities too. Because the AI program developed brain-like activity from scratch, scientists believe that a similar approach could shed light on other mysterious processes in the human brain, such as how limbs are controlled. And it could do so without any need for animal or human experimentation. | But the research opens up fresh possibilities too. Because the AI program developed brain-like activity from scratch, scientists believe that a similar approach could shed light on other mysterious processes in the human brain, such as how limbs are controlled. And it could do so without any need for animal or human experimentation. |
| “There is no reason why we couldn’t use this to understand different functions that the brain performs. It could be a testbed for experiments you wouldn’t otherwise do,” said Caswell Barry, a neuroscientist at University College London who worked on the project. | “There is no reason why we couldn’t use this to understand different functions that the brain performs. It could be a testbed for experiments you wouldn’t otherwise do,” said Caswell Barry, a neuroscientist at University College London who worked on the project. |
| Writing in the journal Nature, the scientists describe how they built a ‘deep neural network’, a computer program that uses multiple layers of artificial neurons to process information. They then taught the program the basics of navigation by feeding it the kinds of signals that encode speed and direction in the brains of foraging rats. With feedback on its performance, the AI got better and better at predicting where it was when it moved around a virtual environment. | Writing in the journal Nature, the scientists describe how they built a ‘deep neural network’, a computer program that uses multiple layers of artificial neurons to process information. They then taught the program the basics of navigation by feeding it the kinds of signals that encode speed and direction in the brains of foraging rats. With feedback on its performance, the AI got better and better at predicting where it was when it moved around a virtual environment. |
| The scientists hoped that with training the AI program might develop its own grid cell-like activity, and that is precisely what they found. A quarter of the artificial neurons in one layer of the deep neural network had begun firing like biological grid cells. In other words, the AI hit on the same strategy to map out the world as the human brain did long ago. “We were surprised how well it worked,” said Caswell. “The degree of similarity is absolutely striking.” | The scientists hoped that with training the AI program might develop its own grid cell-like activity, and that is precisely what they found. A quarter of the artificial neurons in one layer of the deep neural network had begun firing like biological grid cells. In other words, the AI hit on the same strategy to map out the world as the human brain did long ago. “We were surprised how well it worked,” said Caswell. “The degree of similarity is absolutely striking.” |
| Grid cells are fundamental for navigation in humans and other mammals. They behave as if an invisible mesh of hexagons has been laid over the land, firing rapidly when an animal crosses from one hexagon to the next. In reality, some hexagons are big, others are small, and many overlap. Neuroscientists suspect that this imaginary mesh helps all mammals work out where they are and calculate the shortest path to their goal. | Grid cells are fundamental for navigation in humans and other mammals. They behave as if an invisible mesh of hexagons has been laid over the land, firing rapidly when an animal crosses from one hexagon to the next. In reality, some hexagons are big, others are small, and many overlap. Neuroscientists suspect that this imaginary mesh helps all mammals work out where they are and calculate the shortest path to their goal. |
| In the next stage of the project, the scientists went on to build a more sophisticated AI that incorporated the artificial grid cell network. They then let it loose on a virtual reality maze game. Tests in the game showed that the AI used grid cells not only to track its position, but also to work out the direction and distance to its goal, so it could take the most direct route. | In the next stage of the project, the scientists went on to build a more sophisticated AI that incorporated the artificial grid cell network. They then let it loose on a virtual reality maze game. Tests in the game showed that the AI used grid cells not only to track its position, but also to work out the direction and distance to its goal, so it could take the most direct route. |
| “We tend to think of navigation as a very everyday thing, but it’s something we don’t understand very well,” said Kumaran. “What our study does is shed light on the neural mechanisms that underlie human navigation.” | “We tend to think of navigation as a very everyday thing, but it’s something we don’t understand very well,” said Kumaran. “What our study does is shed light on the neural mechanisms that underlie human navigation.” |
| Francesco Savelli, an expert in artificial intelligence and neuroscience at Johns Hopkins University in Maryland, said that the magic of AI systems like the one used is that they come up with their own ways of processing data to solve the task at hand. “The emergence of grid cells in this model is an impressive demonstration of exactly that,” he said. | Francesco Savelli, an expert in artificial intelligence and neuroscience at Johns Hopkins University in Maryland, said that the magic of AI systems like the one used is that they come up with their own ways of processing data to solve the task at hand. “The emergence of grid cells in this model is an impressive demonstration of exactly that,” he said. |
| This article contains affiliate links, which means we may earn a small commission if a reader clicks through and makes a purchase. All our journalism is independent and is in no way influenced by any advertiser or commercial initiative. The links are powered by Skimlinks. By clicking on an affiliate link, you accept that Skimlinks cookies will be set. More information. | |
| Artificial intelligence (AI) | Artificial intelligence (AI) |
| DeepMind | DeepMind |
| Consciousness | Consciousness |
| Computing | Computing |
| news | news |
| Share on Facebook | Share on Facebook |
| Share on Twitter | Share on Twitter |
| Share via Email | Share via Email |
| Share on LinkedIn | Share on LinkedIn |
| Share on Pinterest | Share on Pinterest |
| Share on Google+ | Share on Google+ |
| Share on WhatsApp | Share on WhatsApp |
| Share on Messenger | Share on Messenger |
| Reuse this content | Reuse this content |