Better Generalization with Less Human Annotation Using Meta-Learning and Self-Supervised Learning for Image Analysis

Deep neural networks require a large amount of annotated training data to generalize well. Unfortunately, such large training data is difficult to obtain in medical or geophysical domains due to many reasons, including the high annotation cost, privacy concerns, and physical constraints. To address the data efficiency issue in training the deep learning model, we proposed the solutions in two directions: meta-learning and self-supervised learning. Meta-learning tries to generate a robust model that can learn to quickly adapt to new tasks with minimal labeled samples. It is also called “learning to learn”, which acquires fast adaptation capability over a collection of related tasks and uses it to improve its future learning performance. Self-supervised learning, on the other hand, tries to leverage all useful information from the unlabeled training data itself. It can improve feature representation by solving a pretext task, or directly solving the unsupervised target task which shares the same task structure as the self-supervised task. In the first part of this work, we introduce the meta-learning setting, develop a meta-learning framework AGILE+ to deliver the efficient rat brain cell classifier, and study the first arrival picking problem and solve the domain shift problem with less human interaction. In the second part, we discuss different self-supervised learning settings, introduce the 3D self-supervised image patch reconstruction task to significantly improve the incidental lung nodule classification accuracy for the data-hungry 3D Vision Transformer (3D-ViT) model, and propose the self-supervised learning model Blind-Trace Network (BTN) for the application in the unsupervised seismic interpolation task.

Name thesis:degree_name

Doctor of Philosophy

Level thesis:degree_level

Doctoral

Discipline thesis:degree_discipline

Electrical Engineering

Grantor

University of Houston

Year dc:date.issued

2022

Author dc:creator

• Yuan, Pengyu

Advisor dc:contributor.advisor

• Nguyen, Hien Van

Committee members dc:contributor.committeemember

• Chen, Jiefu
• Han, Zhu
• Wu, Xuqing
• Wong, Stephen T.

• Meta-learning
• Self-supervised learning
• Image analysis
• Few-shot learning

Statement dc:rights

• The author of this work is the copyright owner. UH Libraries and the Texas Digital Library have their permission to store and provide access to this work. UH Libraries has secured permission to reproduce any and all previously published materials contained in the work. Further transmission, reproduction, or presentation of this work is prohibited except with permission of the author(s).

Language dc:language.iso

eng

Handle dc:identifier.uri

https://hdl.handle.net/10657/14318

OAI identifier oai:identifier

oai:uh-ir.tdl.org:10657/14318