{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/110555"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/110555","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Domain-agnostic named entity recognition on unstructured text","abstract":"Named Entity Recognition (NER) is the task of extracting informing entities belonging to predefined semantic classes from raw text. These semantic classes could be general-purpose like a person, location or domain-specific like genes, protein names in biomedical texts. NER has widespread applications in natural language processing (NLP) and serves as the foundation for applications like question answering, information retrieval and machine translation. Recently, the NER task has got a lot of traction in the research community with the advent of deep learning models like BERT which are able to capture textual semantics very well. In this work, we present a detailed study approaching the NER task from three different perspectives, namely, sequence labeling, question answering (QA), and span-based classification. We propose a simple span detection and classification pipeline that first detects all mention spans irrespective of entity type and then feeds each mention span as input to a model and expects entity type as output. This setup is the reverse of a traditional QA-based NER system where we feed entity type as input and expect mention spans as output. We also introduce explicit pattern embeddings which compliment character embeddings to learn better word representations even with less training data. Experimental results demonstrate the effectiveness of our proposed domain-agnostic techniques on multiple datasets. We set the new state-of-the-art for BioNLP13CG and give a competitive performance on CoNLL 2003 and JNLPBA datasets. Additionally, we probe into the BERT model and show that mere concatenation of external feature vectors with BERT outputs may not train effectively at the recommended low learning rates for BERT. More sophisticated feature fusion is essential.","abstract_html":"Named Entity Recognition (NER) is the task of extracting informing entities belonging to predefined semantic classes from raw text. These semantic classes could be general-purpose like a person, location or domain-specific like genes, protein names in biomedical texts. NER has widespread applications in natural language processing (NLP) and serves as the foundation for applications like question answering, information retrieval and machine translation. Recently, the NER task has got a lot of traction in the research community with the advent of deep learning models like BERT which are able to capture textual semantics very well. In this work, we present a detailed study approaching the NER task from three different perspectives, namely, sequence labeling, question answering (QA), and span-based classification. We propose a simple span detection and classification pipeline that first detects all mention spans irrespective of entity type and then feeds each mention span as input to a model and expects entity type as output. This setup is the reverse of a traditional QA-based NER system where we feed entity type as input and expect mention spans as output. We also introduce explicit pattern embeddings which compliment character embeddings to learn better word representations even with less training data. Experimental results demonstrate the effectiveness of our proposed domain-agnostic techniques on multiple datasets. We set the new state-of-the-art for BioNLP13CG and give a competitive performance on CoNLL 2003 and JNLPBA datasets. Additionally, we probe into the BERT model and show that mere concatenation of external feature vectors with BERT outputs may not train effectively at the recommended low learning rates for BERT. More sophisticated feature fusion is essential.","abstract_has_math":false,"creators":["Arora, Jatin"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Han, Jiawei"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-09-17T01:11:15Z","date_published":"2021-09-17T01:11:15Z","updated_at":"2026-07-22T22:24:52Z","subjects":["named entity recognition","ner","information extraction","knowledge extraction","deep learning","bert","biomedical entity extraction","general domain ner","entity chunking","entity identification","word patterns","sequence labeling","question answering","span detection","phrase detection","entity typing","phrase classification","span classification","mention detection","natural language processing","nlp","text mining","data mining","machine learning","neural networks"],"languages":["en"],"rights":["Copyright 2021 Jatin Arora"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/110555","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Han, Jiawei"]},{"key":"dc:creator","label":"Author","values":["Arora, Jatin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-09-17T01:11:15Z","2021-04-26","2021-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["named entity recognition","ner","information extraction","knowledge extraction","deep learning","bert","biomedical entity extraction","general domain ner","entity chunking","entity identification","word patterns","sequence labeling","question answering","span detection","phrase detection","entity typing","phrase classification","span classification","mention detection","natural language processing","nlp","text mining","data mining","machine learning","neural networks"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2021 Jatin Arora"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/110555"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Named Entity Recognition (NER) is the task of extracting informing entities belonging to predefined semantic classes from raw text. These semantic classes could be general-purpose like a person, location or domain-specific like genes, protein names in biomedical texts. NER has widespread applications in natural language processing (NLP) and serves as the foundation for applications like question answering, information retrieval and machine translation. Recently, the NER task has got a lot of traction in the research community with the advent of deep learning models like BERT which are able to capture textual semantics very well. In this work, we present a detailed study approaching the NER task from three different perspectives, namely, sequence labeling, question answering (QA), and span-based classification. We propose a simple span detection and classification pipeline that first detects all mention spans irrespective of entity type and then feeds each mention span as input to a model and expects entity type as output. This setup is the reverse of a traditional QA-based NER system where we feed entity type as input and expect mention spans as output. We also introduce explicit pattern embeddings which compliment character embeddings to learn better word representations even with less training data. Experimental results demonstrate the effectiveness of our proposed domain-agnostic techniques on multiple datasets. We set the new state-of-the-art for BioNLP13CG and give a competitive performance on CoNLL 2003 and JNLPBA datasets. Additionally, we probe into the BERT model and show that mere concatenation of external feature vectors with BERT outputs may not train effectively at the recommended low learning rates for BERT. More sophisticated feature fusion is essential.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2021-09-16 without embargo terms","The student, Jatin Arora, accepted the attached license on 2021-04-22 at 18:38.","The student, Jatin Arora, submitted this Thesis for approval on 2021-04-22 at 19:23.","This Thesis was approved for publication on 2021-04-26 at 11:48.","DSpace SAF Submission Ingestion Package generated from Vireo submission #16516 on 2021-09-16 at 16:47:19","Made available in DSpace on 2021-09-17T01:11:15Z (GMT). No. of bitstreams: 3 ARORA-THESIS-2021.pdf: 378776 bytes, checksum: a1c30756c7e5c8346ec6c657ae66d4a0 (MD5) JatinArora-MS-CS-Thesis-Source.zip: 154334 bytes, checksum: afb48c4f9b3f14dc8994229fc3c0d588 (MD5) LICENSE.txt: 4208 bytes, checksum: 494dcebc0812ab8938d846ad76749772 (MD5) Previous issue date: 2021-04-26"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Domain-agnostic named entity recognition on unstructured text"]}]}],"canonical_facts":{"dc:contributor":["Han, Jiawei"],"dc:creator":["Arora, Jatin"],"dc:date":["2021-09-17T01:11:15Z","2021-04-26","2021-05"],"dc:description":["Named Entity Recognition (NER) is the task of extracting informing entities belonging to predefined semantic classes from raw text. These semantic classes could be general-purpose like a person, location or domain-specific like genes, protein names in biomedical texts. NER has widespread applications in natural language processing (NLP) and serves as the foundation for applications like question answering, information retrieval and machine translation. Recently, the NER task has got a lot of traction in the research community with the advent of deep learning models like BERT which are able to capture textual semantics very well. In this work, we present a detailed study approaching the NER task from three different perspectives, namely, sequence labeling, question answering (QA), and span-based classification. We propose a simple span detection and classification pipeline that first detects all mention spans irrespective of entity type and then feeds each mention span as input to a model and expects entity type as output. This setup is the reverse of a traditional QA-based NER system where we feed entity type as input and expect mention spans as output. We also introduce explicit pattern embeddings which compliment character embeddings to learn better word representations even with less training data. Experimental results demonstrate the effectiveness of our proposed domain-agnostic techniques on multiple datasets. We set the new state-of-the-art for BioNLP13CG and give a competitive performance on CoNLL 2003 and JNLPBA datasets. Additionally, we probe into the BERT model and show that mere concatenation of external feature vectors with BERT outputs may not train effectively at the recommended low learning rates for BERT. More sophisticated feature fusion is essential.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2021-09-16 without embargo terms","The student, Jatin Arora, accepted the attached license on 2021-04-22 at 18:38.","The student, Jatin Arora, submitted this Thesis for approval on 2021-04-22 at 19:23.","This Thesis was approved for publication on 2021-04-26 at 11:48.","DSpace SAF Submission Ingestion Package generated from Vireo submission #16516 on 2021-09-16 at 16:47:19","Made available in DSpace on 2021-09-17T01:11:15Z (GMT). No. of bitstreams: 3 ARORA-THESIS-2021.pdf: 378776 bytes, checksum: a1c30756c7e5c8346ec6c657ae66d4a0 (MD5) JatinArora-MS-CS-Thesis-Source.zip: 154334 bytes, checksum: afb48c4f9b3f14dc8994229fc3c0d588 (MD5) LICENSE.txt: 4208 bytes, checksum: 494dcebc0812ab8938d846ad76749772 (MD5) Previous issue date: 2021-04-26"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/110555"],"dc:language":["en"],"dc:rights":["Copyright 2021 Jatin Arora"],"dc:subject":["named entity recognition","ner","information extraction","knowledge extraction","deep learning","bert","biomedical entity extraction","general domain ner","entity chunking","entity identification","word patterns","sequence labeling","question answering","span detection","phrase detection","entity typing","phrase classification","span classification","mention detection","natural language processing","nlp","text mining","data mining","machine learning","neural networks"],"dc:title":["Domain-agnostic named entity recognition on unstructured text"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:52Z"}