Summary: Researchers report it is now possible for machines to learn how artificial and natural systems work by simply observing them.
Source: University of Sheffield.
Researchers working with swarm robots make major breakthrough.
It is now possible for machines to learn how natural or artificial systems work by simply observing them, without being told what to look for, according to researchers at the University of Sheffield.
This could mean advances in the world of technology with machines able to predict, among other things, human behaviour.
The discovery takes inspiration from the work of pioneering computer scientist Alan Turing, who proposed a test, which a machine could pass if it behaved indistinguishably from a human. In this test, an interrogator exchanges messages with two players in a different room: one human, the other a machine.
The interrogator has to find out which of the two players is human. If they consistently fail to do so – meaning that they are no more successful than if they had chosen one player at random – the machine has passed the test, and is considered to have human-level intelligence.
Dr Roderich Gross from the Department of Automatic Control and Systems Engineering at the University of Sheffield, said: “Our study uses the Turing test to reveal how a given system – not necessarily a human – works. In our case, we put a swarm of robots under surveillance and wanted to find out which rules caused their movements. To do so, we put a second swarm – made of learning robots – under surveillance too. The movements of all the robots were recorded, and the motion data shown to interrogators.”
He added: “Unlike in the original Turing test, however, our interrogators are not human but rather computer programs that learn by themselves. Their task is to distinguish between robots from either swarm. They are rewarded for correctly categorising the motion data from the original swarm as genuine, and those from the other swarm as counterfeit. The learning robots that succeed in fooling an interrogator – making it believe their motion data were genuine – receive a reward.”
Dr Gross explained the advantage of the approach, called ‘Turing Learning’, is that humans no longer need to tell machines what to look for.
“Imagine you want a robot to paint like Picasso. Conventional machine learning algorithms would rate the robot’s paintings for how closely they resembled a Picasso. But someone would have to tell the algorithms what is considered similar to a Picasso to begin with. Turing Learning does not require such prior knowledge. It would simply reward the robot if it painted something that was considered genuine by the interrogators. Turing Learning would simultaneously learn how to interrogate and how to paint.”
Dr Gross said he believed Turing Learning could lead to advances in science and technology.
“Scientists could use it to discover the rules governing natural or artificial systems, especially where behaviour cannot be easily characterised using similarity metrics,” he said.
“Computer games, for example, could gain in realism as virtual players could observe and assume characteristic traits of their human counterparts. They would not simply copy the observed behaviour, but rather reveal what makes human players distinctive from the rest.”
The discovery could also be used to create algorithms that detect abnormalities in behaviour. This could prove useful for the health monitoring of livestock and for the preventive maintenance of machines, cars and airplanes.
Turing Learning could also be used in security applications, such as for lie detection or online identity verification.
So far, Dr Gross and his team have tested Turing Learning in robot swarms but the next step is to reveal the workings of some animal collectives such as schools of fish or colonies of bees. This could lead to a better understanding of what factors influence the behaviour of these animals, and eventually inform policy for their protection.
Funding: Funding provided by Wellcome Trust.
Source: Kirsty Bowen – University of Sheffield
Image Source: This NeuroscienceNews.com image is adapted from the University of Sheffield press release.
Original Research: Full open access research for “Turing learning: a metric-free approach to inferring behavior and its application to swarms” by Wei Li, Melvin Gauci, and Roderich Groß in Swarm Intelligence. Published online August 30 2016 doi:10.1007/s11721-016-0126-1
[cbtabs][cbtab title=”MLA”]University of Sheffield. “Machines Can Learn By Simply Observing.” NeuroscienceNews. NeuroscienceNews, 31 August 2016.
<https://neurosciencenews.com/machine-learning-observation-4938/>.[/cbtab][cbtab title=”APA”]University of Sheffield. (2016, August 31). Machines Can Learn By Simply Observing. NeuroscienceNews. Retrieved August 31, 2016 from https://neurosciencenews.com/machine-learning-observation-4938/[/cbtab][cbtab title=”Chicago”]University of Sheffield. “Machines Can Learn By Simply Observing.” https://neurosciencenews.com/machine-learning-observation-4938/ (accessed August 31, 2016).[/cbtab][/cbtabs]
Abstract
Turing learning: a metric-free approach to inferring behavior and its application to swarms
We propose Turing Learning, a novel system identification method for inferring the behavior of natural or artificial systems. Turing Learning simultaneously optimizes two populations of computer programs, one representing models of the behavior of the system under investigation, and the other representing classifiers. By observing the behavior of the system as well as the behaviors produced by the models, two sets of data samples are obtained. The classifiers are rewarded for discriminating between these two sets, that is, for correctly categorizing data samples as either genuine or counterfeit. Conversely, the models are rewarded for ‘tricking’ the classifiers into categorizing their data samples as genuine. Unlike other methods for system identification, Turing Learning does not require predefined metrics to quantify the difference between the system and its models. We present two case studies with swarms of simulated robots and prove that the underlying behaviors cannot be inferred by a metric-based system identification method. By contrast, Turing Learning infers the behaviors with high accuracy. It also produces a useful by-product—the classifiers—that can be used to detect abnormal behavior in the swarm. Moreover, we show that Turing Learning also successfully infers the behavior of physical robot swarms. The results show that collective behaviors can be directly inferred from motion trajectories of individuals in the swarm, which may have significant implications for the study of animal collectives. Furthermore, Turing Learning could prove useful whenever a behavior is not easily characterizable using metrics, making it suitable for a wide range of applications.
“Turing learning: a metric-free approach to inferring behavior and its application to swarms” by Wei Li, Melvin Gauci, and Roderich Groß in Swarm Intelligence. Published online August 30 2016 doi:10.1007/s11721-016-0126-1
