Multimodal Data Fusion for Deep Learning Applications in Intracoronary Image Segmentation

This thesis describes steps towards the construction of a multi-anatomical, multimodal segmentation and co-registration platform for intracoronary images. Although manual annotation and co-registration of intracoronary images from different modalities remain the gold standard today for facilitating the use of intravascular image analysis and morphological component extraction in guiding clinical decision-making, building automated pipelines for these tasks is of increasing interest to optimize these processes. This thesis consists of the construction of an optimized and robust multianatomical segmentation model, with experimentation detailed on different possible modes of pre-training. We also contribute to the process of creating a flexible, reliable platform that can segment and co-register intracoronary images of different imaging modalities, improving upon an in-house non-rigid registration procedure for co-registering coronary computed tomography angiography (CCTA) and optical coherence tomography (OCT) frames with the initialization of a new hybrid model that uses user-inputted fiduciary bifurcations as landmarks to guide the non-rigid registration process for intermediary frames in multimodal pullbacks. We hypothesize that this will enable the co-registration model to account for the global environment when aligning corresponding frames rather than relying solely on local optimization. The simultaneous development of both intravascular image segmentation and co-registration processes is conducted to contribute towards a greater ambition of creating a platform that can segment and co-register images from multiple modalities, pre and post-intervention.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2023

Author dc:creator

• Ahn, So Hee

Advisor dc:contributor.advisor

• Edelman, Elazer R.

Statement dc:rights

• In Copyright - Educational Use Permitted
• Copyright retained by author(s)

Licence dc:rights.uri

• https://rightsstatements.org/page/InC-EDU/1.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/151472

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/151472