keyword
MENU ▼
Read by QxMD icon Read
search

reward prediction error

keyword
https://www.readbyqxmd.com/read/29331446/intolerance-of-uncertainty-neural-and-psychophysiological-correlates-of-the-perception-of-uncertainty-as-threatening
#1
REVIEW
Ema Tanovic, Dylan G Gee, Jutta Joormann
Intolerance of uncertainty (IU) reflects the perception of uncertainty as threatening, regardless of the true probability of threat. IU is elevated in various forms of psychopathology, uniquely associated with anxiety and depression symptoms after controlling for related constructs, and prospectively predicts symptoms. Given the ubiquity of uncertainty in daily life and the clinical implications of IU, recent work has begun to investigate the neural and psychophysiological correlates of IU. This review summarizes the existing literature and integrates findings within a mechanistic neural model of responding to uncertainty...
January 6, 2018: Clinical Psychology Review
https://www.readbyqxmd.com/read/29297512/the-protective-action-encoding-of-serotonin-transients-in-the-human-brain
#2
Rosalyn J Moran, Kenneth T Kishida, Terry Lohrenz, Ignacio Saez, Adrian W Laxton, Mark R Witcher, Stephen B Tatter, Thomas L Ellis, Paul Em Phillips, Peter Dayan, P Read Montague
The role of serotonin in human brain function remains elusive due, at least in part, to our inability to measure rapidly the local concentration of this neurotransmitter. We used fast-scan cyclic voltammetry to infer serotonergic signaling from the striatum of fourteen brains of human patients with Parkinson's disease. Here we report these novel measurements and show that they correlate with outcomes and decisions in a sequential investment game. We find that serotonergic concentrations transiently increase as a whole following negative reward prediction errors, while reversing when counterfactual losses predominate...
January 3, 2018: Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology
https://www.readbyqxmd.com/read/29290550/exploration-disrupts-choice-predictive-signals-and-alters-dynamics-in-prefrontal-cortex
#3
R Becket Ebitz, Eddy Albarran, Tirin Moore
In uncertain environments, decision-makers must balance two goals: they must "exploit" rewarding options but also "explore" in order to discover rewarding alternatives. Exploring and exploiting necessarily change how the brain responds to identical stimuli, but little is known about how these states, and transitions between them, change how the brain transforms sensory information into action. To address this question, we recorded neural activity in a prefrontal sensorimotor area while monkeys naturally switched between exploring and exploiting rewarding options...
December 27, 2017: Neuron
https://www.readbyqxmd.com/read/29285721/altered-monetary-loss-processing-and-reinforcement-based-learning-in-individuals-with-obesity
#4
Jana Kube, David Mathar, Annette Horstmann, Sonja A Kotz, Arno Villringer, Jane Neumann
Individuals with obesity are often characterized by alterations in reward processing. This may affect how new information is used to update stimulus values during reinforcement-based learning. Here, we investigated obesity-related changes in non-food reinforcement processing, their impact on learning performance as well as the neural underpinnings of reinforcement-based learning in obesity. Nineteen individuals with obesity (BMI > = 30 kg/m2, 10 female) and 23 lean control participants (BMI 18.5-24...
December 29, 2017: Brain Imaging and Behavior
https://www.readbyqxmd.com/read/29243134/sensory-uncertainty-impacts-avoidance-during-spatial-decisions
#5
Kevin Jarbo, Rory Flemming, Timothy D Verstynen
When making risky spatial decisions, humans incorporate estimates of sensorimotor variability and costs on outcomes to bias their spatial selections away from regions that incur feedback penalties. Since selection variability depends on the reliability of sensory signals, increasing the spatial variance of targets during visually guided actions should increase the degree of this avoidance. Healthy adult participants (N = 20) used a computer mouse to indicate their selection of the mean of a target, represented as a 2D Gaussian distribution of dots presented on a computer display...
December 14, 2017: Experimental Brain Research. Experimentelle Hirnforschung. Expérimentation Cérébrale
https://www.readbyqxmd.com/read/29221752/chronic-nicotine-exposure-impairs-uncertainty-modulation-on-reinforcement-learning-in-anterior-cingulate-cortex-and-serotonin-system
#6
Zhengde Wei, Long Han, Xiuying Zhong, Ying Liu, Rujing Zha, Ying Wang, Li-Zhuang Yang, Junjie Bu, Hongwen Song, Wenjuan Wang, Yifeng Zhou, Ping Gao, Xiaochu Zhang
Deficits in the computational processes of reinforcement learning have been suggested to underlie addiction. Additionally, environmental uncertainty, which is encoded in the anterior cingulate cortex (ACC), modulates reward prediction errors (RPEs) during reinforcement learning and exacerbates addiction. The present study tested whether and how the ACC would have an essential role in drug addiction by failing to use uncertainty to modulate the RPEs during reinforcement learning. In Experiment I, we found that the ACC/medial prefrontal cortex (MPFC) did not modulate RPE learning according to uncertainty in smokers...
December 5, 2017: NeuroImage
https://www.readbyqxmd.com/read/29208491/feedback-information-and-the-reward-positivity
#7
Jeffrey Cockburn, Clay B Holroyd
The reward positivity is a component of the event-related brain potential (ERP) sensitive to neural mechanisms of reward processing. Multiple studies have demonstrated that reward positivity amplitude indices a reward prediction error signal that is fundamental to theories of reinforcement learning. However, whether this ERP component is also sensitive to richer forms of performance information important for supervised learning is less clear. To investigate this question, we recorded the electroencephalogram from participants engaged in a time estimation task in which the type of error information conveyed by feedback stimuli was systematically varied across conditions...
December 2, 2017: International Journal of Psychophysiology
https://www.readbyqxmd.com/read/29196772/correlation-of-cue-locked-frn-and-feedback-locked-frn-in-the-auditory-monetary-incentive-delay-task
#8
Elena Krugliakova, Vasily Klucharev, Tommaso Fedele, Alexey Gorin, Aleksandra Kuznetsova, Anna Shestakova
Reflecting the discrepancy between received and predicted outcomes, the reward prediction error (RPE) plays an important role in learning in a dynamic environment. A number of studies suggested that the feedback-related negativity (FRN) component of an event-related potential, known to be associated with unexpected outcomes, encodes RPEs. While FRN was clearly shown to be sensitive to the probability of outcomes, the effect of outcome magnitude on FRN remains to be further clarified. In studies on the neural underpinnings of reward anticipation and outcome evaluation, a monetary incentive delay (MID) task proved to be particularly useful...
December 1, 2017: Experimental Brain Research. Experimentelle Hirnforschung. Expérimentation Cérébrale
https://www.readbyqxmd.com/read/29188399/the-alcoholic-brain-neural-bases-of-impaired-reward-based-decision-making-in-alcohol-use-disorders
#9
Caterina Galandra, Gianpaolo Basso, Stefano Cappa, Nicola Canessa
Neuroeconomics is providing insights into the neural bases of decision-making in normal and pathological conditions. In the neuropsychiatric domain, this discipline investigates how abnormal functioning of neural systems associated with reward processing and cognitive control promotes different disorders, and whether such evidence may inform treatments. This endeavor is crucial when studying different types of addiction, which share a core promoting mechanism in the imbalance between impulsive subcortical neural signals associated with immediate pleasurable outcomes and inhibitory signals mediated by a prefrontal reflective system...
November 29, 2017: Neurological Sciences
https://www.readbyqxmd.com/read/29183793/the-electrocortical-response-to-rewarding-and-aversive-feedback-the-reward-positivity-does-not-reflect-salience-in-simple-gambling-tasks
#10
Elizabeth M Mulligan, Greg Hajcak
The Reward Positivity (RewP) is an event-related potential (ERP) potentiated to monetary gains and reduced to monetary losses. Recently, competing data suggest that more salient outcomes elicit a positivity relative to less salient outcomes, regardless of valence. However, all previous work testing the impact of salience on the RewP have examined expected versus unexpected outcomes. In the current study, participants completed the same gambling task twice in which feedback was equally probable: in one condition, feedback indicated monetary gain or loss-and in the other condition, feedback indicated either safety or punishment from subsequent electric shock...
November 25, 2017: International Journal of Psychophysiology
https://www.readbyqxmd.com/read/29163075/pauses-in-striatal-cholinergic-interneurons-what-is-revealed-by-their-common-themes-and-variations
#11
REVIEW
Yan-Feng Zhang, Stephanie J Cragg
Striatal cholinergic interneurons, the so-called tonically active neurons (TANs), pause their firing in response to sensory cues and rewards during classical conditioning and instrumental tasks. The respective pause responses observed can demonstrate many commonalities, such as constant latency and duration, synchronous occurrence in a population of cells, and coincidence with phasic activities of midbrain dopamine neurons (DANs) that signal reward predictions and errors. Pauses can however also show divergent properties...
2017: Frontiers in Systems Neuroscience
https://www.readbyqxmd.com/read/29163004/cardiac-concomitants-of-feedback-and-prediction-error-processing-in-reinforcement-learning
#12
Lucas Kastner, Jana Kube, Arno Villringer, Jane Neumann
Successful learning hinges on the evaluation of positive and negative feedback. We assessed differential learning from reward and punishment in a monetary reinforcement learning paradigm, together with cardiac concomitants of positive and negative feedback processing. On the behavioral level, learning from reward resulted in more advantageous behavior than learning from punishment, suggesting a differential impact of reward and punishment on successful feedback-based learning. On the autonomic level, learning and feedback processing were closely mirrored by phasic cardiac responses on a trial-by-trial basis: (1) Negative feedback was accompanied by faster and prolonged heart rate deceleration compared to positive feedback...
2017: Frontiers in Neuroscience
https://www.readbyqxmd.com/read/29133424/dopamine-reward-prediction-error-signal-codes-the-temporal-evaluation-of-a-perceptual-decision-report
#13
Stefania Sarno, Victor de Lafuente, Ranulfo Romo, Néstor Parga
Learning to associate unambiguous sensory cues with rewarded choices is known to be mediated by dopamine (DA) neurons. However, little is known about how these neurons behave when choices rely on uncertain reward-predicting stimuli. To study this issue we reanalyzed DA recordings from monkeys engaged in the detection of weak tactile stimuli delivered at random times and formulated a reinforcement learning model based on belief states. Specifically, we investigated how the firing activity of DA neurons should behave if they were coding the error in the prediction of the total future reward when animals made decisions relying on uncertain sensory and temporal information...
November 13, 2017: Proceedings of the National Academy of Sciences of the United States of America
https://www.readbyqxmd.com/read/29131512/the-role-of-the-anterior-cingulate-cortex-in-prediction-error-and-signaling-surprise
#14
William H Alexander, Joshua W Brown
In the past two decades, reinforcement learning (RL) has become a popular framework for understanding brain function. A key component of RL models, prediction error, has been associated with neural signals throughout the brain, including subcortical nuclei, primary sensory cortices, and prefrontal cortex. Depending on the location in which activity is observed, the functional interpretation of prediction error may change: Prediction errors may reflect a discrepancy in the anticipated and actual value of reward, a signal indicating the salience or novelty of a stimulus, and many other interpretations...
November 13, 2017: Topics in Cognitive Science
https://www.readbyqxmd.com/read/29126885/medial-frontal-cortex-response-to-unexpected-motivationally-salient-outcomes
#15
Heather E Soder, Geoffrey F Potts
The medial frontal cortex (MFC) plays a central role allocating resources to process salient information, in part by responding to prediction errors. While there is some recent debate, the feedback-related negativity (FRN) is thought to index a reward prediction error by signaling outcomes that are worse than expected. A recent study utilizing electric shock provided data inconsistent with these accounts and reported that the omission of both appetitive (money) and aversive outcomes (electric shocks) elicited a medial frontal negativity...
November 7, 2017: International Journal of Psychophysiology
https://www.readbyqxmd.com/read/29109253/a-transient-dopamine-signal-encodes-subjective-value-and-causally-influences-demand-in-an-economic-context
#16
Scott A Schelp, Katherine J Pultorak, Dylan R Rakowski, Devan M Gomez, Gregory Krzystyniak, Raibatak Das, Erik B Oleson
The mesolimbic dopamine system is strongly implicated in motivational processes. Currently accepted theories suggest that transient mesolimbic dopamine release events energize reward seeking and encode reward value. During the pursuit of reward, critical associations are formed between the reward and cues that predict its availability. Conditioned by these experiences, dopamine neurons begin to fire upon the earliest presentation of a cue, and again at the receipt of reward. The resulting dopamine concentration scales proportionally to the value of the reward...
November 6, 2017: Proceedings of the National Academy of Sciences of the United States of America
https://www.readbyqxmd.com/read/29103933/optogenetic-blockade-of-dopamine-transients-prevents-learning-induced-by-changes-in-reward-features
#17
Chun Yun Chang, Matthew Gardner, Maria Gonzalez Di Tillio, Geoffrey Schoenbaum
Prediction errors are critical for associative learning [1, 2]. Transient changes in dopamine neuron activity correlate with positive and negative reward prediction errors and can mimic their effects [3-15]. However, although causal studies show that dopamine transients of 1-2 s are sufficient to drive learning about reward, these studies do not address whether they are necessary (but see [11]). Further, the precise nature of this signal is not yet fully established. Although it has been equated with the cached-value error signal proposed to support model-free reinforcement learning, cached-value errors are typically confounded with errors in the prediction of reward features [16]...
November 20, 2017: Current Biology: CB
https://www.readbyqxmd.com/read/29096115/model-based-predictions-for-dopamine
#18
REVIEW
Angela J Langdon, Melissa J Sharpe, Geoffrey Schoenbaum, Yael Niv
Phasic dopamine responses are thought to encode a prediction-error signal consistent with model-free reinforcement learning theories. However, a number of recent findings highlight the influence of model-based computations on dopamine responses, and suggest that dopamine prediction errors reflect more dimensions of an expected outcome than scalar reward value. Here, we review a selection of these recent results and discuss the implications and complications of model-based predictions for computational theories of dopamine and learning...
October 30, 2017: Current Opinion in Neurobiology
https://www.readbyqxmd.com/read/29089641/roles-of-dopamine-neurons-in-mediating-the-prediction-error-in-aversive-learning-in-insects
#19
Kanta Terao, Makoto Mizunami
In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. The prediction error theory has been proposed to account for the finding of a blocking phenomenon, in which pairing of a stimulus X with an unconditioned stimulus (US) could block subsequent association of a second stimulus Y to the US when the two stimuli were paired in compound with the same US. Evidence for this theory, however, has been imperfect since blocking can also be accounted for by competitive theories...
October 31, 2017: Scientific Reports
https://www.readbyqxmd.com/read/29080714/hippocampal-morphology-mediates-biased-memories-of-chronic-pain
#20
Sara E Berger, Étienne Vachon-Presseau, Taha B Abdullah, Alex T Baria, Thomas J Schnitzer, A Vania Apkarian
Experiences and memories are often mismatched. While multiple studies have investigated psychological underpinnings of recall error with respect to emotional events, the neurobiological mechanisms underlying the divergence between experiences and memories remain relatively unexplored in the domain of chronic pain. Here we examined the discrepancy between experienced chronic low back pain (CBP) intensity (twice daily ratings) and remembered pain intensity (n = 48 subjects) relative to psychometric properties, hippocampus morphology, memory capabilities, and personality traits related to reward...
November 6, 2017: NeuroImage
keyword
keyword
86861
1
2
Fetch more papers »
Fetching more papers... Fetching...
Read by QxMD. Sign in or create an account to discover new knowledge that matter to you.
Remove bar
Read by QxMD icon Read
×

Search Tips

Use Boolean operators: AND/OR

diabetic AND foot
diabetes OR diabetic

Exclude a word using the 'minus' sign

Virchow -triad

Use Parentheses

water AND (cup OR glass)

Add an asterisk (*) at end of a word to include word stems

Neuro* will search for Neurology, Neuroscientist, Neurological, and so on

Use quotes to search for an exact phrase

"primary prevention of cancer"
(heart or cardiac or cardio*) AND arrest -"American Heart Association"