{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/98123"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/98123","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"The influence of semantics on the visual processing of natural scenes","abstract":"A long standing question in cognitive science has been: is visual processing completely encapsulated and separate from semantics or can visual processing be influenced by semantics? We address this question in two ways: 1) Do pictures and words share similar representations and 2) Does semantics modulate visual processing. Using multi-voxel pattern analysis (MVPA) and fMRI decoding we examined the similarity of neural activity across pictures and words that describe natural scenes. A whole brain MVPA searchlight revealed multiple brain regions in the occipitotemporal, posterior parietal and frontal cortices that showed transfer from pictures to words and from words to pictures. In addition to sharing similar representations across pictures and words, can words dynamically influence the processing of visual stimuli? Using Event Related Potentials (ERPs) and good and bad exemplars of natural scenes, we show that top-down expectation, initiated via a category cue (e.g. the word ‘Beach’), dynamically influences the processing of natural scenes. Good and bad exemplars first evoked differential ERPs in the time-window 250-350 ms from stimulus onset, with the bad exemplars showing greater negativity over frontal electrode sites, when the cue matched the image. Interestingly, this good/bad effect disappeared when the images were mismatched to the cue. Overall, these studies taken together, provide evidence for the influence of semantics on the visual processing of natural scenes.","abstract_html":"A long standing question in cognitive science has been: is visual processing completely encapsulated and separate from semantics or can visual processing be influenced by semantics? We address this question in two ways: 1) Do pictures and words share similar representations and 2) Does semantics modulate visual processing. Using multi-voxel pattern analysis (MVPA) and fMRI decoding we examined the similarity of neural activity across pictures and words that describe natural scenes. A whole brain MVPA searchlight revealed multiple brain regions in the occipitotemporal, posterior parietal and frontal cortices that showed transfer from pictures to words and from words to pictures. In addition to sharing similar representations across pictures and words, can words dynamically influence the processing of visual stimuli? Using Event Related Potentials (ERPs) and good and bad exemplars of natural scenes, we show that top-down expectation, initiated via a category cue (e.g. the word ‘Beach’), dynamically influences the processing of natural scenes. Good and bad exemplars first evoked differential ERPs in the time-window 250-350 ms from stimulus onset, with the bad exemplars showing greater negativity over frontal electrode sites, when the cue matched the image. Interestingly, this good/bad effect disappeared when the images were mismatched to the cue. Overall, these studies taken together, provide evidence for the influence of semantics on the visual processing of natural scenes.","abstract_has_math":false,"creators":["Kumar, Manoj"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Neuroscience","degree_department":null,"school":null,"contributors":["Beck, Diane M.","Federmeier, Kara D.","Gratton, Gabriele","Koyejo, Oluwasanmi"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2017,"date_issued":"2017-09-29T16:37:58Z","date_published":"2017-09-29T16:37:58Z","updated_at":"2026-07-22T22:24:34Z","subjects":["Natural scenes","Semantics","Statistical regularities","Multi-voxel pattern analysis (MVPA)","Era"],"languages":["en"],"rights":["Copyright 2017 Manoj Kumar"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/98123","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Beck, Diane M.","Federmeier, Kara D.","Gratton, Gabriele","Koyejo, Oluwasanmi"]},{"key":"dc:creator","label":"Author","values":["Kumar, Manoj"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2017-09-29T16:37:58Z","2017-06-28","2017-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Neuroscience"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Natural scenes","Semantics","Statistical regularities","Multi-voxel pattern analysis (MVPA)","Era"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2017 Manoj Kumar"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/98123"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["A long standing question in cognitive science has been: is visual processing completely encapsulated and separate from semantics or can visual processing be influenced by semantics? We address this question in two ways: 1) Do pictures and words share similar representations and 2) Does semantics modulate visual processing. Using multi-voxel pattern analysis (MVPA) and fMRI decoding we examined the similarity of neural activity across pictures and words that describe natural scenes. A whole brain MVPA searchlight revealed multiple brain regions in the occipitotemporal, posterior parietal and frontal cortices that showed transfer from pictures to words and from words to pictures. In addition to sharing similar representations across pictures and words, can words dynamically influence the processing of visual stimuli? Using Event Related Potentials (ERPs) and good and bad exemplars of natural scenes, we show that top-down expectation, initiated via a category cue (e.g. the word ‘Beach’), dynamically influences the processing of natural scenes. Good and bad exemplars first evoked differential ERPs in the time-window 250-350 ms from stimulus onset, with the bad exemplars showing greater negativity over frontal electrode sites, when the cue matched the image. Interestingly, this good/bad effect disappeared when the images were mismatched to the cue. Overall, these studies taken together, provide evidence for the influence of semantics on the visual processing of natural scenes.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-09-29 without embargo terms","The student, Manoj Kumar, accepted the attached license on 2017-06-19 at 12:13.","The student, Manoj Kumar, submitted this Dissertation for approval on 2017-06-19 at 12:22.","This Dissertation was approved for publication on 2017-06-28 at 13:19.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11238 on 2017-09-29 at 11:26:45","Made available in DSpace on 2017-09-29T16:37:58Z (GMT). No. of bitstreams: 2 KUMAR-DISSERTATION-2017.pdf: 4364927 bytes, checksum: a14150e305ff1686ec2d4c6eab3a7515 (MD5) LICENSE.txt: 4208 bytes, checksum: 00e75067af3127979088a4e6bb3af974 (MD5) Previous issue date: 2017-06-28"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["The influence of semantics on the visual processing of natural scenes"]}]}],"canonical_facts":{"dc:contributor":["Beck, Diane M.","Federmeier, Kara D.","Gratton, Gabriele","Koyejo, Oluwasanmi"],"dc:creator":["Kumar, Manoj"],"dc:date":["2017-09-29T16:37:58Z","2017-06-28","2017-08"],"dc:description":["A long standing question in cognitive science has been: is visual processing completely encapsulated and separate from semantics or can visual processing be influenced by semantics? We address this question in two ways: 1) Do pictures and words share similar representations and 2) Does semantics modulate visual processing. Using multi-voxel pattern analysis (MVPA) and fMRI decoding we examined the similarity of neural activity across pictures and words that describe natural scenes. A whole brain MVPA searchlight revealed multiple brain regions in the occipitotemporal, posterior parietal and frontal cortices that showed transfer from pictures to words and from words to pictures. In addition to sharing similar representations across pictures and words, can words dynamically influence the processing of visual stimuli? Using Event Related Potentials (ERPs) and good and bad exemplars of natural scenes, we show that top-down expectation, initiated via a category cue (e.g. the word ‘Beach’), dynamically influences the processing of natural scenes. Good and bad exemplars first evoked differential ERPs in the time-window 250-350 ms from stimulus onset, with the bad exemplars showing greater negativity over frontal electrode sites, when the cue matched the image. Interestingly, this good/bad effect disappeared when the images were mismatched to the cue. Overall, these studies taken together, provide evidence for the influence of semantics on the visual processing of natural scenes.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-09-29 without embargo terms","The student, Manoj Kumar, accepted the attached license on 2017-06-19 at 12:13.","The student, Manoj Kumar, submitted this Dissertation for approval on 2017-06-19 at 12:22.","This Dissertation was approved for publication on 2017-06-28 at 13:19.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11238 on 2017-09-29 at 11:26:45","Made available in DSpace on 2017-09-29T16:37:58Z (GMT). No. of bitstreams: 2 KUMAR-DISSERTATION-2017.pdf: 4364927 bytes, checksum: a14150e305ff1686ec2d4c6eab3a7515 (MD5) LICENSE.txt: 4208 bytes, checksum: 00e75067af3127979088a4e6bb3af974 (MD5) Previous issue date: 2017-06-28"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/98123"],"dc:language":["en"],"dc:rights":["Copyright 2017 Manoj Kumar"],"dc:subject":["Natural scenes","Semantics","Statistical regularities","Multi-voxel pattern analysis (MVPA)","Era"],"dc:title":["The influence of semantics on the visual processing of natural scenes"],"dc:type":["text"],"thesis:degree_discipline":["Neuroscience"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:34Z"}