Advances in NLP Algorithms on Unstructured Medical Notes Data and Approaches to Handling Class Imbalance Issues

<p>This dissertation is composed of three research projects, each addressing one aspect of the text classification tasks on unstructured medical notes.</p> <p>The first study investigated the model performance of sequence deep learning models that are widely used in NLP tasks such as RNN, GRU, LSTM, Bi-LSTM, as well as CNN and the novel and more advanced attention-based algorithms such as the Transformer Encoder and BERT-Base. The model performances of these algorithms were evaluated with and without pre-trained word embeddings. The Transformer Encoder model stood out as the best model for all tasks and the CNN model produced comparable performance when the classes were relatively balanced.</p> <p>As an extension of the first study, the second study explored the effects of 20 text data augmentation methods on the same data to handle the issues of class imbalance and small sample size. In addition, the effects of different strategies in terms of the amount of augmentation were also investigated. The results showed that the Splitting Augmenter consistently improved the model performance in all strategies for most tasks, and the largest improvement was 0.13 in F1 score and an impressive 0.34 in AUC-ROC. For highly imbalanced tasks, the strategy that augments the minority class until balanced improved model performance by the largest margin. For other tasks, the best-performing strategy was the one that augments the minority class until balanced and then augments both classes by an additional 10%.</p> <p>The third study was carried out to predict suicidal or self-injurious events to help improve the efficiency of triage for health care services and prevent suicidal and injurious events from happening in the Orange County Jails. This study showed that the medical and mental health progress notes data contain more information about the inmates’ mental health state pertaining to their suicidal or self-injurious tendency than the structured data available in the database. Two different ways of incorporating the information from the notes data in the model building were introduced, and under-sampling was used to effectively mitigate the impact of extremely imbalanced classes.</p>

Name thesis:degree_name

Doctor of Philosophy (PhD)

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Computational and Data Sciences

Year dc:date.available

2022

Author dc:creator

• Lu, Hanna

Contributors dc:contributor

• Cyril Rakovski
• Daniel Alpay
• Chun Hsien Chiang
• Alex Barrett

• NLP
• Deep Learning
• Class Imbalance
• Medical Notes
• Transformer Encoder
• Text Data Augmentation
• Under Sampling
• Suicidal and Self-injurious Events
• Community Health and Preventive Medicine
• Diagnosis
• Health Services Research

Repository record dc:identifier

https://digitalcommons.chapman.edu/cads_dissertations/30

OAI identifier oai:identifier

oai:digitalcommons.chapman.edu:cads_dissertations-1030