The Detection and Characterization of Severe Features in Colonoscopy Videos Using Combined Segmentation and Classification Models

Inflammatory Bowel Disease is a chronic disease that requires regular monitoring procedures, such as colonoscopy. Assessing disease severity through endoscopy is critical to determining therapeutic responses in IBD, but its use in clinical practice is limited by the requirement for experienced human reviewers. In recent development, artificial intelligence is used to evaluate endoscopic disease severity based on colonoscopy images. However, due to the variability in disease phenotypes, the nonrigid nature of objects, and clinical artifacts, very few groups have studied image or video segmentation for colonoscopy videos, and the existing deep learning systems showed low transparency and traceability. We propose a feature-based model that breaks down the problem into smaller components and combines segmentation and classification models to characterize IBD features and predict disease severity for frame-level and clip-level data. Our combined segmentation and classification models had an average accuracy of 90% for the detection of severe IBD features such as ulcerations and erosions. This thesis was completed at Iterative Scopes, a Boston startup working on bringing precision medicine and technology to gastroenterology.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2021

Author dc:creator

• Wang, Yi

Advisors dc:contributor.advisor

• Szolovits, Peter
• Schott, Jean-Pierre

Statement dc:rights

• In Copyright - Educational Use Permitted
• Copyright MIT

Licence dc:rights.uri

• http://rightsstatements.org/page/InC-EDU/1.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/139906

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/139906