{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/38591"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/38591","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"FMRI studies of effects of hearing status on audio-visual speech perception","abstract":"The overall goal of this research is to acquire a more complete picture of the neurological processes of visual influences on speech perception and to investigate effects of hearing status on AV speech perception. More specifically, functional magnetic resonance imaging (fMRI) was used to investigate the brain activity underlying audio-visual speech perception in three groups of subjects: (1) normally hearing, (2) congenitally deafened signers (American Sign Language) who do not use hearing aids, and (3) congenitally hearing impaired individuals with hearing aids. FMRI data were collected while subjects experienced three different types of speech stimuli: video of a speaking face with audio input, audio speech without visual input, and video of a speaking face without audio input. The cortical areas found to be active for speechreading included: visual cortex, auditory cortex (but not primary auditory cortex), speech motor network areas, supramarginal gyrus, thalamus, superior parietal cortex and fusiform gyrus. For hearing impaired subjects, in addition to the areas listed above, Heschl's gyrus, right angular gyrus (AG), cerebellum and regions around right inferior frontal sulcus (IFS) in the frontal lobe were also found to be active.","abstract_html":"The overall goal of this research is to acquire a more complete picture of the neurological processes of visual influences on speech perception and to investigate effects of hearing status on AV speech perception. More specifically, functional magnetic resonance imaging (fMRI) was used to investigate the brain activity underlying audio-visual speech perception in three groups of subjects: (1) normally hearing, (2) congenitally deafened signers (American Sign Language) who do not use hearing aids, and (3) congenitally hearing impaired individuals with hearing aids. FMRI data were collected while subjects experienced three different types of speech stimuli: video of a speaking face with audio input, audio speech without visual input, and video of a speaking face without audio input. The cortical areas found to be active for speechreading included: visual cortex, auditory cortex (but not primary auditory cortex), speech motor network areas, supramarginal gyrus, thalamus, superior parietal cortex and fusiform gyrus. For hearing impaired subjects, in addition to the areas listed above, Heschl's gyrus, right angular gyrus (AG), cerebellum and regions around right inferior frontal sulcus (IFS) in the frontal lobe were also found to be active.","abstract_has_math":false,"creators":["Yoo, Julie J"],"institution":"Massachusetts Institute of Technology","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Harvard University--MIT Division of Health Sciences and Technology.","school":null,"contributors":[],"advisors":["Frank H. Guenther."],"committee_chairs":[],"committee_members":[],"year":2007,"date_issued":"2007","date_published":"2007","updated_at":"2026-07-22T22:21:36Z","subjects":["Harvard University--MIT Division of Health Sciences and Technology."],"languages":["eng"],"rights":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."],"rights_urls":["http://dspace.mit.edu/handle/1721.1/38591","http://dspace.mit.edu/handle/1721.1/7582"],"identifier_entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://dspace.mit.edu/handle/1721.1/38591"],"render_values":[{"text":"http://dspace.mit.edu/handle/1721.1/38591","href":"http://dspace.mit.edu/handle/1721.1/38591","code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/1721.1/38591","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Frank H. Guenther."]},{"key":"dc:contributor.department","label":"Department","values":["Harvard University--MIT Division of Health Sciences and Technology."]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Harvard University--MIT Division of Health Sciences and Technology."]},{"key":"dc:creator","label":"Author","values":["Yoo, Julie J"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2008-11-10T19:49:34Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2008-11-10T19:49:34Z"]},{"key":"dc:date.issued","label":"Date","values":["2007"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Harvard University--MIT Division of Health Sciences and Technology."]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://dspace.mit.edu/handle/1721.1/38591","http://dspace.mit.edu/handle/1721.1/7582"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://dspace.mit.edu/handle/1721.1/38591","http://hdl.handle.net/1721.1/38591"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Thesis (Ph. D.)--Harvard-MIT Division of Health Sciences and Technology, 2007.","Includes bibliographical references (leaves 158-172)."]},{"key":"dc:description.abstract","label":"Abstract","values":["The overall goal of this research is to acquire a more complete picture of the neurological processes of visual influences on speech perception and to investigate effects of hearing status on AV speech perception. More specifically, functional magnetic resonance imaging (fMRI) was used to investigate the brain activity underlying audio-visual speech perception in three groups of subjects: (1) normally hearing, (2) congenitally deafened signers (American Sign Language) who do not use hearing aids, and (3) congenitally hearing impaired individuals with hearing aids. FMRI data were collected while subjects experienced three different types of speech stimuli: video of a speaking face with audio input, audio speech without visual input, and video of a speaking face without audio input. The cortical areas found to be active for speechreading included: visual cortex, auditory cortex (but not primary auditory cortex), speech motor network areas, supramarginal gyrus, thalamus, superior parietal cortex and fusiform gyrus. For hearing impaired subjects, in addition to the areas listed above, Heschl's gyrus, right angular gyrus (AG), cerebellum and regions around right inferior frontal sulcus (IFS) in the frontal lobe were also found to be active.","(cont.) Results from our study added to existing evidence of the engagement of motor-articulatory strategies in visual speech perception. We also found that an individual's speechreading ability is related to the amount of activity in superior temporal cortical areas, including primary auditory cortex, pre-SMA, IFS and right AG during visual speech perception. Results from effective connectivity analyses suggest that posterior superior temporal sulcus may be a potential AV speech integration site; and that AG serves a critical role in visual speech perception when auditory information is absent for hearing subjects, and when auditory information is available for hearing impaired subjects. Also, strong excitatory projections from STS to inferior frontal gyrus (IFG) and premotor/motor areas, and a strong inhibitory projection from IFG to STS seem to play an important role in visual speech perception in all subject groups. Finally, correlation analyses revealed that in hearing aid users, the amount of acoustic and speech signal gained by using hearing aids were significantly correlated with activity in IFG."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Ph.D."]},{"key":"dc:title","label":"Title","values":["FMRI studies of effects of hearing status on audio-visual speech perception"]}]}],"canonical_facts":{"dc:contributor.advisor":["Frank H. Guenther."],"dc:contributor.department":["Harvard University--MIT Division of Health Sciences and Technology."],"dc:contributor.other":["Harvard University--MIT Division of Health Sciences and Technology."],"dc:creator":["Yoo, Julie J"],"dc:date.accessioned":["2008-11-10T19:49:34Z"],"dc:date.available":["2008-11-10T19:49:34Z"],"dc:date.issued":["2007"],"dc:description":["Thesis (Ph. D.)--Harvard-MIT Division of Health Sciences and Technology, 2007.","Includes bibliographical references (leaves 158-172)."],"dc:description.abstract":["The overall goal of this research is to acquire a more complete picture of the neurological processes of visual influences on speech perception and to investigate effects of hearing status on AV speech perception. More specifically, functional magnetic resonance imaging (fMRI) was used to investigate the brain activity underlying audio-visual speech perception in three groups of subjects: (1) normally hearing, (2) congenitally deafened signers (American Sign Language) who do not use hearing aids, and (3) congenitally hearing impaired individuals with hearing aids. FMRI data were collected while subjects experienced three different types of speech stimuli: video of a speaking face with audio input, audio speech without visual input, and video of a speaking face without audio input. The cortical areas found to be active for speechreading included: visual cortex, auditory cortex (but not primary auditory cortex), speech motor network areas, supramarginal gyrus, thalamus, superior parietal cortex and fusiform gyrus. For hearing impaired subjects, in addition to the areas listed above, Heschl's gyrus, right angular gyrus (AG), cerebellum and regions around right inferior frontal sulcus (IFS) in the frontal lobe were also found to be active.","(cont.) Results from our study added to existing evidence of the engagement of motor-articulatory strategies in visual speech perception. We also found that an individual's speechreading ability is related to the amount of activity in superior temporal cortical areas, including primary auditory cortex, pre-SMA, IFS and right AG during visual speech perception. Results from effective connectivity analyses suggest that posterior superior temporal sulcus may be a potential AV speech integration site; and that AG serves a critical role in visual speech perception when auditory information is absent for hearing subjects, and when auditory information is available for hearing impaired subjects. Also, strong excitatory projections from STS to inferior frontal gyrus (IFG) and premotor/motor areas, and a strong inhibitory projection from IFG to STS seem to play an important role in visual speech perception in all subject groups. Finally, correlation analyses revealed that in hearing aid users, the amount of acoustic and speech signal gained by using hearing aids were significantly correlated with activity in IFG."],"dc:description.degree":["Ph.D."],"dc:identifier.uri":["http://dspace.mit.edu/handle/1721.1/38591","http://hdl.handle.net/1721.1/38591"],"dc:language.iso":["eng"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."],"dc:rights.uri":["http://dspace.mit.edu/handle/1721.1/38591","http://dspace.mit.edu/handle/1721.1/7582"],"dc:subject":["Harvard University--MIT Division of Health Sciences and Technology."],"dc:title":["FMRI studies of effects of hearing status on audio-visual speech perception"],"dc:type":["Thesis"]},"updated_at":"2026-07-22T22:21:36Z"}