Learning to Segment Unseen Tasks In-Context

While deep learning models have become the predominant method for medical image segmentation, they are typically incapable of generalizing to new segmentation tasks---involving new anatomies, image modalities, or labels. For a new segmentation task, researchers will often have to prepare new task-specific models. This process is time-consuming and poses a substantial barrier for clinical researchers who often lack the resources and expertise to train neural networks. We present UniverSeg, an in-context learning method for solving unseen medical segmentation tasks. Given a new image to segment, and a set of image-label pairs that define the task, UniverSeg can produce accurate segmentation predictions with no additional training. We demonstrate that UniverSeg substantially outperforms existing methods in solving unseen segmentation tasks, and thoroughly analyze important aspects of our proposed data, training, and inference paradigms.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2024

Author dc:creator

• Butoi, Victor Ion

Advisors dc:contributor.advisor

• Guttag, John V.
• Dalca, Adrian V.

Statement dc:rights

• Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
• Copyright retained by author(s)

Licence dc:rights.uri

• https://creativecommons.org/licenses/by-nc-nd/4.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/156117

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/156117