This dissertation investigates the mechanisms underlying variations in credit assignment to reward cues, with a focus on the lateral orbitofrontal cortex (lOFC). The lOFC has long been implicated in signaling reward expectancies, with controversy as to whether it signals the economic value of future outcomes, their sensory features to guide behavior or both. However, whether the lOFC signals the relative (competition-dependent) or absolute (contiguity-dependent) credit of cues is unknown. To address this, I employed a combination of novel behavioral assays, in-vivo electrophysiological recordings and optogenetic stimulation in rats. In Chapter 2, I tested the suitability of a self-initiating variant of the magazine approach procedure to examine the mechanisms of cue competition. The results show for the first time that agency over trial initiation promotes competitive credit assignment under conditions that normally attenuate it. In Chapter 3, I recorded neural activity in lOFC while rats performed in a novel relative-absolute validity contrast task. Results showed that lOFC neurons encode predictive credit along a competitive-noncompetitive learning continuum, with noncompetitive learning dominating the early stages of training and competitive learning taking increasing control over training. Moreover, encoding of competitive credit emerges late in the cue epoch and gradually migrates to the beginning of the cue as training progresses. This gradual backpropagation pattern, which is predicted by temporal difference reinforcement learning models, had hitherto eluded researchers. In Chapter 4, I report persistent individual differences in credit assignment along the v competitive-noncompetitive continuum and show that these differences correlate with neural activity in lOFC. These findings suggest that some individuals may remain vulnerable to maladaptive responses triggered by incidental cues, which has implications for understanding reward disorders. Finally, in Chapter 5, I examined the causal role of lOFC in credit assignment and discovered that optogenetic inhibition of this region causes paradoxical effects on credit assignment. Specifically, lOFC inhibition makes credit assignment less competitive early in training, but more competitive after extended training. Taken together, these findings underscore the need for further exploration of the neural substrates and clinical implications of the competitive-noncompetitive learning continuum.
","abstract_html":"<p>This dissertation investigates the mechanisms underlying variations in credit assignment to reward cues, with a focus on the lateral orbitofrontal cortex (lOFC). The lOFC has long been implicated in signaling reward expectancies, with controversy as to whether it signals the economic value of future outcomes, their sensory features to guide behavior or both. However, whether the lOFC signals the relative (competition-dependent) or absolute (contiguity-dependent) credit of cues is unknown. To address this, I employed a combination of novel behavioral assays, in-vivo electrophysiological recordings and optogenetic stimulation in rats. In Chapter 2, I tested the suitability of a self-initiating variant of the magazine approach procedure to examine the mechanisms of cue competition. The results show for the first time that agency over trial initiation promotes competitive credit assignment under conditions that normally attenuate it. In Chapter 3, I recorded neural activity in lOFC while rats performed in a novel relative-absolute validity contrast task. Results showed that lOFC neurons encode predictive credit along a competitive-noncompetitive learning continuum, with noncompetitive learning dominating the early stages of training and competitive learning taking increasing control over training. Moreover, encoding of competitive credit emerges late in the cue epoch and gradually migrates to the beginning of the cue as training progresses. This gradual backpropagation pattern, which is predicted by temporal difference reinforcement learning models, had hitherto eluded researchers. In Chapter 4, I report persistent individual differences in credit assignment along the v competitive-noncompetitive continuum and show that these differences correlate with neural activity in lOFC. These findings suggest that some individuals may remain vulnerable to maladaptive responses triggered by incidental cues, which has implications for understanding reward disorders. Finally, in Chapter 5, I examined the causal role of lOFC in credit assignment and discovered that optogenetic inhibition of this region causes paradoxical effects on credit assignment. Specifically, lOFC inhibition makes credit assignment less competitive early in training, but more competitive after extended training. Taken together, these findings underscore the need for further exploration of the neural substrates and clinical implications of the competitive-noncompetitive learning continuum.</p>","abstract_has_math":false,"creators":["Kang, Mihwa"],"institution":"The Graduate School and University Center of The City University of New York","degree_name":"Doctor of Philosophy","degree_level":"Doctoral","degree_discipline":"Biology","degree_department":null,"school":null,"contributors":[],"advisors":["Guillem Esber"],"committee_chairs":[],"committee_members":["Andrew Delamater","Susana Mingote","Jon Horvitz","Anjali Krishnan"],"year":2024,"date_issued":"2024-09-01T07:00:00Z","date_published":"2024-09-01T07:00:00Z","updated_at":"2026-07-24T02:00:04Z","subjects":["Behavioral Neurobiology","Cognitive Neuroscience","credit assignment","cue competition","Temporal Difference Reinforcement Learning","electrophysiology","optogenetics","individual difference"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://academicworks.cuny.edu/gc_etds/6008","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Guillem Esber"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Andrew Delamater","Susana Mingote","Jon Horvitz","Anjali Krishnan"]},{"key":"dc:creator","label":"Author","values":["Kang, Mihwa"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2025-09-14T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Biology"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Doctoral"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["The Graduate School and University Center of The City University of New York"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Behavioral Neurobiology","Cognitive Neuroscience","credit assignment","cue competition","Temporal Difference Reinforcement Learning","electrophysiology","optogenetics","individual difference"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://academicworks.cuny.edu/gc_etds/6008"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This dissertation investigates the mechanisms underlying variations in credit assignment to reward cues, with a focus on the lateral orbitofrontal cortex (lOFC). The lOFC has long been implicated in signaling reward expectancies, with controversy as to whether it signals the economic value of future outcomes, their sensory features to guide behavior or both. However, whether the lOFC signals the relative (competition-dependent) or absolute (contiguity-dependent) credit of cues is unknown. To address this, I employed a combination of novel behavioral assays, in-vivo electrophysiological recordings and optogenetic stimulation in rats. In Chapter 2, I tested the suitability of a self-initiating variant of the magazine approach procedure to examine the mechanisms of cue competition. The results show for the first time that agency over trial initiation promotes competitive credit assignment under conditions that normally attenuate it. In Chapter 3, I recorded neural activity in lOFC while rats performed in a novel relative-absolute validity contrast task. Results showed that lOFC neurons encode predictive credit along a competitive-noncompetitive learning continuum, with noncompetitive learning dominating the early stages of training and competitive learning taking increasing control over training. Moreover, encoding of competitive credit emerges late in the cue epoch and gradually migrates to the beginning of the cue as training progresses. This gradual backpropagation pattern, which is predicted by temporal difference reinforcement learning models, had hitherto eluded researchers. In Chapter 4, I report persistent individual differences in credit assignment along the v competitive-noncompetitive continuum and show that these differences correlate with neural activity in lOFC. These findings suggest that some individuals may remain vulnerable to maladaptive responses triggered by incidental cues, which has implications for understanding reward disorders. Finally, in Chapter 5, I examined the causal role of lOFC in credit assignment and discovered that optogenetic inhibition of this region causes paradoxical effects on credit assignment. Specifically, lOFC inhibition makes credit assignment less competitive early in training, but more competitive after extended training. Taken together, these findings underscore the need for further exploration of the neural substrates and clinical implications of the competitive-noncompetitive learning continuum.
"]},{"key":"dc:title","label":"Title","values":["Competitive and Noncompetitive Credit Assignment to Reward Cues in the Lateral Orbitofrontal Cortex"]}]}],"canonical_facts":{"dc:contributor.advisor":["Guillem Esber"],"dc:contributor.committeemember":["Andrew Delamater","Susana Mingote","Jon Horvitz","Anjali Krishnan"],"dc:creator":["Kang, Mihwa"],"dc:date.available":["2025-09-14T07:00:00Z"],"dc:description.abstract":["This dissertation investigates the mechanisms underlying variations in credit assignment to reward cues, with a focus on the lateral orbitofrontal cortex (lOFC). The lOFC has long been implicated in signaling reward expectancies, with controversy as to whether it signals the economic value of future outcomes, their sensory features to guide behavior or both. However, whether the lOFC signals the relative (competition-dependent) or absolute (contiguity-dependent) credit of cues is unknown. To address this, I employed a combination of novel behavioral assays, in-vivo electrophysiological recordings and optogenetic stimulation in rats. In Chapter 2, I tested the suitability of a self-initiating variant of the magazine approach procedure to examine the mechanisms of cue competition. The results show for the first time that agency over trial initiation promotes competitive credit assignment under conditions that normally attenuate it. In Chapter 3, I recorded neural activity in lOFC while rats performed in a novel relative-absolute validity contrast task. Results showed that lOFC neurons encode predictive credit along a competitive-noncompetitive learning continuum, with noncompetitive learning dominating the early stages of training and competitive learning taking increasing control over training. Moreover, encoding of competitive credit emerges late in the cue epoch and gradually migrates to the beginning of the cue as training progresses. This gradual backpropagation pattern, which is predicted by temporal difference reinforcement learning models, had hitherto eluded researchers. In Chapter 4, I report persistent individual differences in credit assignment along the v competitive-noncompetitive continuum and show that these differences correlate with neural activity in lOFC. These findings suggest that some individuals may remain vulnerable to maladaptive responses triggered by incidental cues, which has implications for understanding reward disorders. Finally, in Chapter 5, I examined the causal role of lOFC in credit assignment and discovered that optogenetic inhibition of this region causes paradoxical effects on credit assignment. Specifically, lOFC inhibition makes credit assignment less competitive early in training, but more competitive after extended training. Taken together, these findings underscore the need for further exploration of the neural substrates and clinical implications of the competitive-noncompetitive learning continuum.
"],"dc:identifier":["https://academicworks.cuny.edu/gc_etds/6008"],"dc:subject":["Behavioral Neurobiology","Cognitive Neuroscience","credit assignment","cue competition","Temporal Difference Reinforcement Learning","electrophysiology","optogenetics","individual difference"],"dc:title":["Competitive and Noncompetitive Credit Assignment to Reward Cues in the Lateral Orbitofrontal Cortex"],"thesis:degree_discipline":["Biology"],"thesis:degree_level":["Doctoral"],"thesis:degree_name":["Doctor of Philosophy"],"thesis:institution_name":["The Graduate School and University Center of The City University of New York"]},"updated_at":"2026-07-24T02:00:04Z"}