Some models of associative learning attempt to explain effects such as blocking and unblocking as reflecting a prediction error (PE): Associative strength, and thereby learning, are said to be greater when the unconditioned stimulus (US) received following a cue deviates from one’s expectations. Some models of PE-motivated behavior and PE-relevant brain activity represent the US as a single quantitative variable for outcome value, and that learning therefore only occurs when outcome value differs from expectations. There is growing evidence to suggest that changes in other dimensions of reward, such as identity and timing, also contribute to learning. In Experiment 1, we ran a blocking/unblocking study where both of these reward domains were unexpectedly reversed upon the introduction of novel stimuli during compound training, without affecting reward value. We then probed the nature of this learning using outcome-specific Pavlovian-to-Instrumental (PIT) testing. PEs of both reward identity and timing enabled learning towards the novel stimuli that would not have otherwise occurred (an “unblocking” effect), and this learning was specific to each reward. In Experiment 2, we trained rats on two stimulus-reward pairs before unexpectedly switching the identities of the rewards that followed each stimulus. Immediately after this reversal, brain tissue was fixed and stained for activity-dependent protein phosphorylation (p-rPS6) and the dopamine (DA) precursor tyrosine hydroxylase (TH). Reward identity PEs did not result in activation of neurons in the orbitofrontal cortex (OFC), basolateral amygdala (BLA), or any component of the striatum. In contrast, reward identity PEs did result in the recruitment of larger neural ensembles in a specific area of the ventral tegmental area (VTA). This effect was not specific to DA neurons. The implications of these findings for PE learning models and the brain structures involved are discussed.
","abstract_html":"<p>Some models of associative learning attempt to explain effects such as blocking and unblocking as reflecting a prediction error (PE): Associative strength, and thereby learning, are said to be greater when the unconditioned stimulus (US) received following a cue deviates from one’s expectations. Some models of PE-motivated behavior and PE-relevant brain activity represent the US as a single quantitative variable for outcome value, and that learning therefore only occurs when outcome value differs from expectations. There is growing evidence to suggest that changes in other dimensions of reward, such as identity and timing, also contribute to learning. In Experiment 1, we ran a blocking/unblocking study where both of these reward domains were unexpectedly reversed upon the introduction of novel stimuli during compound training, without affecting reward value. We then probed the nature of this learning using outcome-specific Pavlovian-to-Instrumental (PIT) testing. PEs of both reward identity and timing enabled learning towards the novel stimuli that would not have otherwise occurred (an “unblocking” effect), and this learning was specific to each reward. In Experiment 2, we trained rats on two stimulus-reward pairs before unexpectedly switching the identities of the rewards that followed each stimulus. Immediately after this reversal, brain tissue was fixed and stained for activity-dependent protein phosphorylation (p-rPS6) and the dopamine (DA) precursor tyrosine hydroxylase (TH). Reward identity PEs did not result in activation of neurons in the orbitofrontal cortex (OFC), basolateral amygdala (BLA), or any component of the striatum. In contrast, reward identity PEs did result in the recruitment of larger neural ensembles in a specific area of the ventral tegmental area (VTA). This effect was not specific to DA neurons. The implications of these findings for PE learning models and the brain structures involved are discussed.</p>","abstract_has_math":false,"creators":["Siegel, Daniel B."],"institution":"The Graduate School and University Center of The City University of New York","degree_name":"Master of Science","degree_level":"Master","degree_discipline":"Cognitive Neuroscience","degree_department":null,"school":null,"contributors":[],"advisors":["Andrew Delamater"],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-09-01T07:00:00Z","date_published":"2021-09-01T07:00:00Z","updated_at":"2026-07-24T02:00:35Z","subjects":["Behavioral Neurobiology","Experimental Analysis of Behavior","learning","prediction error","pavlovian","blocking","unblocking","dopamine"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://academicworks.cuny.edu/gc_etds/4537","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Andrew Delamater"]},{"key":"dc:creator","label":"Author","values":["Siegel, Daniel B."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2021-09-10T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Cognitive Neuroscience"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Master"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["The Graduate School and University Center of The City University of New York"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Behavioral Neurobiology","Experimental Analysis of Behavior","learning","prediction error","pavlovian","blocking","unblocking","dopamine"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://academicworks.cuny.edu/gc_etds/4537"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Some models of associative learning attempt to explain effects such as blocking and unblocking as reflecting a prediction error (PE): Associative strength, and thereby learning, are said to be greater when the unconditioned stimulus (US) received following a cue deviates from one’s expectations. Some models of PE-motivated behavior and PE-relevant brain activity represent the US as a single quantitative variable for outcome value, and that learning therefore only occurs when outcome value differs from expectations. There is growing evidence to suggest that changes in other dimensions of reward, such as identity and timing, also contribute to learning. In Experiment 1, we ran a blocking/unblocking study where both of these reward domains were unexpectedly reversed upon the introduction of novel stimuli during compound training, without affecting reward value. We then probed the nature of this learning using outcome-specific Pavlovian-to-Instrumental (PIT) testing. PEs of both reward identity and timing enabled learning towards the novel stimuli that would not have otherwise occurred (an “unblocking” effect), and this learning was specific to each reward. In Experiment 2, we trained rats on two stimulus-reward pairs before unexpectedly switching the identities of the rewards that followed each stimulus. Immediately after this reversal, brain tissue was fixed and stained for activity-dependent protein phosphorylation (p-rPS6) and the dopamine (DA) precursor tyrosine hydroxylase (TH). Reward identity PEs did not result in activation of neurons in the orbitofrontal cortex (OFC), basolateral amygdala (BLA), or any component of the striatum. In contrast, reward identity PEs did result in the recruitment of larger neural ensembles in a specific area of the ventral tegmental area (VTA). This effect was not specific to DA neurons. The implications of these findings for PE learning models and the brain structures involved are discussed.
"]},{"key":"dc:title","label":"Title","values":["Contributions of Reward Identity and Time Prediction Errors to Pavlovian Learning"]}]}],"canonical_facts":{"dc:contributor.advisor":["Andrew Delamater"],"dc:creator":["Siegel, Daniel B."],"dc:date.available":["2021-09-10T07:00:00Z"],"dc:description.abstract":["Some models of associative learning attempt to explain effects such as blocking and unblocking as reflecting a prediction error (PE): Associative strength, and thereby learning, are said to be greater when the unconditioned stimulus (US) received following a cue deviates from one’s expectations. Some models of PE-motivated behavior and PE-relevant brain activity represent the US as a single quantitative variable for outcome value, and that learning therefore only occurs when outcome value differs from expectations. There is growing evidence to suggest that changes in other dimensions of reward, such as identity and timing, also contribute to learning. In Experiment 1, we ran a blocking/unblocking study where both of these reward domains were unexpectedly reversed upon the introduction of novel stimuli during compound training, without affecting reward value. We then probed the nature of this learning using outcome-specific Pavlovian-to-Instrumental (PIT) testing. PEs of both reward identity and timing enabled learning towards the novel stimuli that would not have otherwise occurred (an “unblocking” effect), and this learning was specific to each reward. In Experiment 2, we trained rats on two stimulus-reward pairs before unexpectedly switching the identities of the rewards that followed each stimulus. Immediately after this reversal, brain tissue was fixed and stained for activity-dependent protein phosphorylation (p-rPS6) and the dopamine (DA) precursor tyrosine hydroxylase (TH). Reward identity PEs did not result in activation of neurons in the orbitofrontal cortex (OFC), basolateral amygdala (BLA), or any component of the striatum. In contrast, reward identity PEs did result in the recruitment of larger neural ensembles in a specific area of the ventral tegmental area (VTA). This effect was not specific to DA neurons. The implications of these findings for PE learning models and the brain structures involved are discussed.
"],"dc:identifier":["https://academicworks.cuny.edu/gc_etds/4537"],"dc:subject":["Behavioral Neurobiology","Experimental Analysis of Behavior","learning","prediction error","pavlovian","blocking","unblocking","dopamine"],"dc:title":["Contributions of Reward Identity and Time Prediction Errors to Pavlovian Learning"],"thesis:degree_discipline":["Cognitive Neuroscience"],"thesis:degree_level":["Master"],"thesis:degree_name":["Master of Science"],"thesis:institution_name":["The Graduate School and University Center of The City University of New York"]},"updated_at":"2026-07-24T02:00:35Z"}