{"id":{"repo_id":"ku","oai_identifier":"oai:kuscholarworks.ku.edu:1808/37716"},"canonical_url":"https://search.dev.ndltd.org/etd/ku/oai:kuscholarworks.ku.edu:1808/37716","repository":{"repo_id":"ku","name":"University of Kansas","base_url":"https://kuscholarworks.ku.edu/server/oai/request"},"display":{"title":"On the Security of Speech-based Machine Translation Systems: Vulnerabilities and Attacks","abstract":"In the light of rapid advancement of global connectivity and the increasing reliance onmultilingual communication, speech-based Machine Translation (MT) systems have emerged as essential technologies for facilitating seamless cross-lingual interaction. These systems enable individuals and organizations to overcome linguistic boundaries by automatically translating spoken language in real time. However, despite their growing ubiquity in var- ious applications such as virtual assistants, international conferencing, and accessibility services, the security and robustness of speech-based MT systems remain underexplored. In particular, limited attention has been given to understanding their vulnerabilities under ad- versarial conditions, where malicious actors intentionally craft or manipulate speech inputs to mislead or degrade translation performance. This thesis presents a comprehensive investigation into the security landscape of speech- based machine translation systems from an adversarial perspective. We systematically cat- egorize and analyze potential attack vectors, evaluate their success rates across diverse system architectures and environmental settings, and explore the practical implications of such attacks. Furthermore, through a series of controlled experiments and human-subject evaluations, we demonstrate that adversarial manipulations can significantly distort transla- tion outputs in realistic use cases, thereby posing tangible risks to communication reliability and user trust. Our findings reveal critical weaknesses in current MT models and underscore the ur- gent need for developing more resilient defense strategies. We also discuss open research challenges and propose directions for building secure, trustworthy, and ethically responsible speech translation technologies. Ultimately, this work contributes to a deeper understand- ing of adversarial robustness in multimodal language systems and provides a foundation for advancing the security of next-generation machine translation frameworks.","abstract_html":"In the light of rapid advancement of global connectivity and the increasing reliance onmultilingual communication, speech-based Machine Translation (MT) systems have emerged as essential technologies for facilitating seamless cross-lingual interaction. These systems enable individuals and organizations to overcome linguistic boundaries by automatically translating spoken language in real time. However, despite their growing ubiquity in var- ious applications such as virtual assistants, international conferencing, and accessibility services, the security and robustness of speech-based MT systems remain underexplored. In particular, limited attention has been given to understanding their vulnerabilities under ad- versarial conditions, where malicious actors intentionally craft or manipulate speech inputs to mislead or degrade translation performance. This thesis presents a comprehensive investigation into the security landscape of speech- based machine translation systems from an adversarial perspective. We systematically cat- egorize and analyze potential attack vectors, evaluate their success rates across diverse system architectures and environmental settings, and explore the practical implications of such attacks. Furthermore, through a series of controlled experiments and human-subject evaluations, we demonstrate that adversarial manipulations can significantly distort transla- tion outputs in realistic use cases, thereby posing tangible risks to communication reliability and user trust. Our findings reveal critical weaknesses in current MT models and underscore the ur- gent need for developing more resilient defense strategies. We also discuss open research challenges and propose directions for building secure, trustworthy, and ethically responsible speech translation technologies. Ultimately, this work contributes to a deeper understand- ing of adversarial robustness in multimodal language systems and provides a foundation for advancing the security of next-generation machine translation frameworks.","abstract_has_math":false,"creators":["Zhao, Junyi"],"institution":"University of Kansas","degree_name":"M.S.","degree_level":null,"degree_discipline":"Electrical Engineering & Computer Science","degree_department":null,"school":null,"contributors":[],"advisors":["Luo, Bo"],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-12-31","date_published":"2025-12-31","updated_at":"2026-07-24T02:45:54Z","subjects":["Cybersecurity","Machine Translation","Natural Language Processing"],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["https://www.proquest.com/LegacyDocView/DISSNUM/32398587"],"render_values":[{"text":"https://www.proquest.com/LegacyDocView/DISSNUM/32398587","href":"https://www.proquest.com/LegacyDocView/DISSNUM/32398587","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/1808/37716","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Luo, Bo"]},{"key":"dc:creator","label":"Author","values":["Zhao, Junyi"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-04-17T00:40:14Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2026-04-17T00:40:14Z"]},{"key":"dc:date.issued","label":"Date","values":["2025-12-31"]},{"key":"dc:publisher","label":"Institution","values":["University of Kansas"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical Engineering & Computer Science"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Cybersecurity","Machine Translation","Natural Language Processing"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["https://www.proquest.com/LegacyDocView/DISSNUM/32398587"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1808/37716"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["In the light of rapid advancement of global connectivity and the increasing reliance onmultilingual communication, speech-based Machine Translation (MT) systems have emerged as essential technologies for facilitating seamless cross-lingual interaction. These systems enable individuals and organizations to overcome linguistic boundaries by automatically translating spoken language in real time. However, despite their growing ubiquity in var- ious applications such as virtual assistants, international conferencing, and accessibility services, the security and robustness of speech-based MT systems remain underexplored. In particular, limited attention has been given to understanding their vulnerabilities under ad- versarial conditions, where malicious actors intentionally craft or manipulate speech inputs to mislead or degrade translation performance. This thesis presents a comprehensive investigation into the security landscape of speech- based machine translation systems from an adversarial perspective. We systematically cat- egorize and analyze potential attack vectors, evaluate their success rates across diverse system architectures and environmental settings, and explore the practical implications of such attacks. Furthermore, through a series of controlled experiments and human-subject evaluations, we demonstrate that adversarial manipulations can significantly distort transla- tion outputs in realistic use cases, thereby posing tangible risks to communication reliability and user trust. Our findings reveal critical weaknesses in current MT models and underscore the ur- gent need for developing more resilient defense strategies. We also discuss open research challenges and propose directions for building secure, trustworthy, and ethically responsible speech translation technologies. Ultimately, this work contributes to a deeper understand- ing of adversarial robustness in multimodal language systems and provides a foundation for advancing the security of next-generation machine translation frameworks."]},{"key":"dc:title","label":"Title","values":["On the Security of Speech-based Machine Translation Systems: Vulnerabilities and Attacks"]}]}],"canonical_facts":{"dc:contributor.advisor":["Luo, Bo"],"dc:creator":["Zhao, Junyi"],"dc:date.accessioned":["2026-04-17T00:40:14Z"],"dc:date.available":["2026-04-17T00:40:14Z"],"dc:date.issued":["2025-12-31"],"dc:description.abstract":["In the light of rapid advancement of global connectivity and the increasing reliance onmultilingual communication, speech-based Machine Translation (MT) systems have emerged as essential technologies for facilitating seamless cross-lingual interaction. These systems enable individuals and organizations to overcome linguistic boundaries by automatically translating spoken language in real time. However, despite their growing ubiquity in var- ious applications such as virtual assistants, international conferencing, and accessibility services, the security and robustness of speech-based MT systems remain underexplored. In particular, limited attention has been given to understanding their vulnerabilities under ad- versarial conditions, where malicious actors intentionally craft or manipulate speech inputs to mislead or degrade translation performance. This thesis presents a comprehensive investigation into the security landscape of speech- based machine translation systems from an adversarial perspective. We systematically cat- egorize and analyze potential attack vectors, evaluate their success rates across diverse system architectures and environmental settings, and explore the practical implications of such attacks. Furthermore, through a series of controlled experiments and human-subject evaluations, we demonstrate that adversarial manipulations can significantly distort transla- tion outputs in realistic use cases, thereby posing tangible risks to communication reliability and user trust. Our findings reveal critical weaknesses in current MT models and underscore the ur- gent need for developing more resilient defense strategies. We also discuss open research challenges and propose directions for building secure, trustworthy, and ethically responsible speech translation technologies. Ultimately, this work contributes to a deeper understand- ing of adversarial robustness in multimodal language systems and provides a foundation for advancing the security of next-generation machine translation frameworks."],"dc:identifier.other":["https://www.proquest.com/LegacyDocView/DISSNUM/32398587"],"dc:identifier.uri":["https://hdl.handle.net/1808/37716"],"dc:language.iso":["en"],"dc:publisher":["University of Kansas"],"dc:subject":["Cybersecurity","Machine Translation","Natural Language Processing"],"dc:title":["On the Security of Speech-based Machine Translation Systems: Vulnerabilities and Attacks"],"dc:type":["Thesis"],"thesis:degree_discipline":["Electrical Engineering & Computer Science"],"thesis:degree_name":["M.S."]},"updated_at":"2026-07-24T02:45:54Z"}