The brain produces feelings of confidence that inform decisions the same way statistics pulls patterns out of noisy data.
The directions, which came via cell phone, were a little garbled, but as you understood them: “Turn left at the 3rd light and go straight; the restaurant will be on your right side.” Ten minutes ago you made the turn. Still no restaurant in sight. How far will you be willing to drive in the same direction?
Research suggests that it depends on your initial level of confidence after getting the directions. Did you hear them right? Did you turn at the 3rd light? Could you have driven past the restaurant? Were the directions incorrect?
Human brains are constantly processing data to make statistical assessments that translate into the feeling we call confidence, according to a study published today in Neuron. This feeling of confidence is central to decision making, and, despite ample evidence of human fallibility, the subjective feeling relies on objective calculations.
“The feeling ultimately relies on the same statistical computations a computer would make,” says Professor Adam Kepecs, a neuroscientist at Cold Spring Harbor Laboratory (CSHL) and lead author of the new study.
“People often focus on the situations where confidence is divorced from reality,” he says. “But if confidence were always error-prone, what would be its function? If we didn’t have the ability to optimally assess confidence, we’d routinely find ourselves driving around for hours in this scenario.”
Calculating confidence for a statistician involves looking at a set of data—perhaps a sampling of marbles pulled from a bag—and making a conclusion about the entire bag based on that sample. “The feeling of confidence and the objective calculation are related intuitively,” says Kepecs. “But how much so?”
In experiments with human subjects, Kepecs and colleagues tried to control for different factors that can vary from person to person. The aim was to establish what evidence contributed to each decision. In this way they could compare people’s reports of confidence with the optimal statistical answer. “If we can quantify the evidence that informs a person’s decision, then we can ask how well a statistical algorithm performs on the same evidence,” says Kepecs.
He and graduate student Joshua Sanders created video games to compare human and computer performance. They had human volunteers listen to streams of clicking sounds and determine which clicks were faster. Participants rated confidence in each choice on a scale of one (a random guess) to five (high confidence). What Kepecs and his colleagues found was that human responses were similar to statistical calculations. The brain produces feelings of confidence that inform decisions the same way statistics pulls patterns out of noisy data.
Kepecs’s model for human confidence stood up to a follow-on experiment in which participants answered questions comparing the populations of various countries. Unlike the perceptual test, this one had the added complexity of each participant’s individual knowledge base.
The development of a model for confidence is a first step toward Kepecs’ ultimate goal to find out where this inner statistician sits in the brain and how it does its data processing. It is Kepecs’ thesis that statistics – generated by the objective processing of sensory and other data – is the ultimate language of the brain.
It’s likely that the statistical computation the research reveals provides only an initial estimate for human decision-makers. “Human confidence reports are not equivalent to this computation,” Kepecs says. “In the experiments we conducted, they mirror this computation, and we suspect that in more complex situations they will be the point of departure for a confidence report.”
Kepecs plans to use his model of confidence as a foothold for finding the seat of confidence in the brain and understanding its neural circuitry. “Having a theory about confidence is a required first step to figure out how the brain actually does it, how nerve cells perform this process,” he says.
The work may also have wider implications. The fields of statistics and, in particular, machine learning, may have something to learn from this inner statistician. “Humans are still better than computers at solving really difficult problems,” says Kepecs.
Funding: This work was supported by the National Institutes of Health.
Source: Peter Tarr – Cold Spring Harbor Laboratory
Image Source: The image is credited to Julia Kuhl.
Original Research: Full open access research for “Signatures of a statistical computation in the human sense of confidence” by Joshua I. Sanders, Balázs Hangya, and Adam Kepecs in PNAS. Published online April 6 2016 doi:10.1016/j.neuron.2016.03.025
Abstract
Signatures of a statistical computation in the human sense of confidence
Highlights
•Statistical principles govern how evidence informs the formation of human confidence
•Human confidence reports follow qualitative predictions of statistical confidence
•With one noise parameter we provide a quantitative account of confidence reports
Summary
Human confidence judgments are thought to originate from metacognitive processes that provide a subjective assessment about one’s beliefs. Alternatively, confidence is framed in mathematics as an objective statistical quantity: the probability that a chosen hypothesis is correct. Despite similar terminology, it remains unclear whether the subjective feeling of confidence is related to the objective, statistical computation of confidence. To address this, we collected confidence reports from humans performing perceptual and knowledge-based psychometric decision tasks. We observed two counterintuitive patterns relating confidence to choice and evidence: apparent overconfidence in choices based on uninformative evidence, and decreasing confidence with increasing evidence strength for erroneous choices. We show that these patterns lawfully arise from statistical confidence, and therefore occur even for perfectly calibrated confidence measures. Furthermore, statistical confidence quantitatively accounted for human confidence in our tasks without necessitating heuristic operations. Accordingly, we suggest that the human feeling of confidence originates from a mental computation of statistical confidence.
“Signatures of a statistical computation in the human sense of confidence” by Joshua I. Sanders, Balázs Hangya, and Adam Kepecs in PNAS. Published online April 6 2016 doi:10.1016/j.neuron.2016.03.025
