{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/127164"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/127164","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Association knowledge in natural language learning","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","abstract_has_math":false,"creators":["Yu, Pengfei"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Ji, Heng","Han, Jiawei","Hoiem, Derek","Neubig, Graham","Yih, Scott"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-10-28","date_published":"2024-10-28","updated_at":"2026-07-22T22:25:03Z","subjects":["Natural Language Processing","Association Modeling","Information Extraction","Knowledge Editing"],"languages":["en","eng"],"rights":["Copyright 2024 Pengfei Yu"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/127164","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Ji, Heng","Han, Jiawei","Hoiem, Derek","Neubig, Graham","Yih, Scott"]},{"key":"dc:creator","label":"Author","values":["Yu, Pengfei"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-10-28","2024-12"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Natural Language Processing","Association Modeling","Information Extraction","Knowledge Editing"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Pengfei Yu"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/127164"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","The student, Pengfei Yu, accepted the attached license on 2024-10-22 at 22:35.","The student, Pengfei Yu, submitted this Dissertation for approval on 2024-10-22 at 22:41.","This Dissertation was approved for publication on 2024-10-28 at 10:53.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21267 on 2025-03-28 at 14:25:12","Association is an important feature of natural language originates from the human's cognitive ability to associate concepts. It is the key to unveiling the computational mechanism of natural language, which is closely related to the research of natural language processing (NLP). However, the current dominant learning paradigm, which is based on neural models that combine distributed representations with probabilistic modeling, demonstrates insufficient capabilities in modeling associations in natural language. To compensate for the deficiency, we mathematically formulate the concept of Association Knowledge as the joint distribution over the probabilities of instances and establish a general methodology to incorporate association knowledge into the training architecture of neural models. We delve into Association Knowledge through a series of case studies across various dimensions, including associations among types of knowledge, languages, instances and unstructured information. These case studies span both smaller neural models and large language models. Through our investigations, we demonstrate that explicitly integrating Association Knowledge into neural architectures markedly improves model performance and efficiency. This enhanced capability is evident in diverse scenarios, from improving event detection in lifelong learning settings and facilitating robust cross-lingual translations, to enhancing the detection of long-tail mentions and refining the updates in large language models. Collectively, our findings underscore the pivotal role of Association Knowledge in advancing the state of NLP by fostering more robust and knowledge-aware neural models."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Association knowledge in natural language learning"]}]}],"canonical_facts":{"dc:contributor":["Ji, Heng","Han, Jiawei","Hoiem, Derek","Neubig, Graham","Yih, Scott"],"dc:creator":["Yu, Pengfei"],"dc:date":["2024-10-28","2024-12"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","The student, Pengfei Yu, accepted the attached license on 2024-10-22 at 22:35.","The student, Pengfei Yu, submitted this Dissertation for approval on 2024-10-22 at 22:41.","This Dissertation was approved for publication on 2024-10-28 at 10:53.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21267 on 2025-03-28 at 14:25:12","Association is an important feature of natural language originates from the human's cognitive ability to associate concepts. It is the key to unveiling the computational mechanism of natural language, which is closely related to the research of natural language processing (NLP). However, the current dominant learning paradigm, which is based on neural models that combine distributed representations with probabilistic modeling, demonstrates insufficient capabilities in modeling associations in natural language. To compensate for the deficiency, we mathematically formulate the concept of Association Knowledge as the joint distribution over the probabilities of instances and establish a general methodology to incorporate association knowledge into the training architecture of neural models. We delve into Association Knowledge through a series of case studies across various dimensions, including associations among types of knowledge, languages, instances and unstructured information. These case studies span both smaller neural models and large language models. Through our investigations, we demonstrate that explicitly integrating Association Knowledge into neural architectures markedly improves model performance and efficiency. This enhanced capability is evident in diverse scenarios, from improving event detection in lifelong learning settings and facilitating robust cross-lingual translations, to enhancing the detection of long-tail mentions and refining the updates in large language models. Collectively, our findings underscore the pivotal role of Association Knowledge in advancing the state of NLP by fostering more robust and knowledge-aware neural models."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/127164"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Pengfei Yu"],"dc:subject":["Natural Language Processing","Association Modeling","Information Extraction","Knowledge Editing"],"dc:title":["Association knowledge in natural language learning"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:03Z"}