Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 10 of 10 for “"transformer-based language models"”.
-
Beyond pre-training: continual learning and hallucinations in transformer-based language models.
Pre-trained transformer models have become the norm for various language modelling tasks from document similarity analysis and text classification to natural language generation. Despite the impressive performance on benchmark datasets, adopting pretrained models for real-world applications often …
-
Insights into the South African research landscape through mining theses and dissertations using transformer-based language models
… productivity, temporal growth patterns, language use, retention dynamics, and citation characteristics of postgraduate research between 2000 and 2024. The results reveal a concentration of postgraduate research output among a small number of institutions, sustained growth prior to 2020, …
-
Transformer-based models for answer extraction in text-based question/answering
The success of transformer-based language models has led to a surge of research in various natural language processing tasks, among which extractive question-answering/answer span detection, has received considerable attention in recent years. However, to date, no comprehensive studies have been …
-
Spoken Language Processing and Modeling for Aviation Communications
… aviation-specific corpora, applying natural language processing technologies, especially those based on transformer neural networks, to aviation communications is becoming increasingly feasible. Previous work has focused on machine learning applications to natural language processing, such as …
-
Table manners at scale: introducing Lora Lens for efficient analysis & detoxification of language models
Transformer-based language models have achieved significant advancements across numerous natural language processing (NLP) tasks. However, as these models grow in scale and complexity, ensuring interpretability and mitigating toxic outputs become increasingly critical challenges. This thesis …
-
Text and data mining of semiconductor material information from scientific literature
… band gap information, using natural language processing techniques, machine-learning algorithms, and language models. Chapter 1 gives a description of data-driven material discovery, an overview of chemical data extraction from scientific documents, and the motivation of generating …
-
Evaluating automated and hybrid neural disambiguation for African historical named entities
… them to a knowledge base. In recent years, transformer-based language models have led to improvements in NED systems. Furthermore, multilingual language models have shown the ability to learn concepts across languages, reducing the amount of training data required in low-resource languages. …
-
MEng Thesis: Incorporating Structured Commonsense into Language Models
… variety of applications in the field of natural language processing (NLP). One such application is fine-tuning large pre-trained models to a wide variety of tasks. In this work, we propose methods to enhance these large language models by infusing them with information found in commonsense …
-
Knowledge Graphs and Large Language Models for Intelligent Applications in the Tourism Domain
… various sectors. Among these advancements, Large Language Models (LLM) stand out as transformative technologies in many domains. This thesis delves into an integrative exploration, juxtaposing the structured world of KGs and the raw data reservoirs of Data Lakes, together with a focus on …
-
Self-attentive generative adversarial network-based authorship attribution in historical texts
… texts, this study aims to follow a deep-learning-based approach to perform authorship attribution in historical texts. This thesis introduces a novel approach to authorship attribution in historical texts, addressing the complexities of authorship disguise and deception. By utilising deep …