Self-supervised Learning Methods for Vision-based Tasks

Dealing with large amounts of unlabeled data is a very challenging task. Recently, many different approaches have been proposed to leverage this data for training many machine learning models. Among them, self-supervised learning appears as an efficient solution capable of training powerful and generalizable models. More specifically, instead of relying on human-generated labels, it proposes training objectives that use ``labels'' generated from the data itself, either via data augmentation or by masking the data in some way and trying to reconstruct it. Apart from being able to train models from scratch, self-supervised methods can also be used in specific applications to further improve a pre-trained model. In this thesis, we propose to leverage self-supervised methods in novel ways to tackle different application scenarios. We present four published papers: an open-source library for self-supervised learning that is flexible, scalable, and easy to use; two papers tackling unsupervised domain adaptation in action recognition; and one paper on self-supervised learning for continual learning. The published papers highlight that self-supervised techniques can be leveraged for many scenarios, yielding state-of-the-art results.

Grantor dc:publisher

Università degli studi di Trento

Year dc:date

2024

Author dc:creator

• Turrisi Da Costa, Victor Guilherme

Contributors dc:contributor

• Sebe, Niculae

• Self-supervised Learning, Unsupervised Domain Adaptation, Continual Learning.

Statement dc:rights

• info:eu-repo/semantics/openAccess
• license:Creative commons
• license uri:http://creativecommons.org/licenses/by-sa/4.0/

Language dc:language

eng

Identifier

http://dx.doi.org/10.15168/11572_408090
10.15168/11572_408090

OAI identifier oai:identifier

oai:iris.unitn.it:11572/408090