{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/117813"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/117813","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Sample-efficient learning with self-supervision","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","abstract_has_math":false,"creators":["Zhong, Yuanyi"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Wang, Yuxiong","Peng, Jian","Forsyth, David","Zhang, Lei"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-12","date_published":"2022-12","updated_at":"2026-07-22T22:24:56Z","subjects":["Deep Learning","Self-supervised Learning","Computer Vision","Reinforcement Learning","Sample Efficiency","Artificial Intelligence"],"languages":["en","eng"],"rights":["Copyright 2022 Yuanyi Zhong"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/117813","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Wang, Yuxiong","Peng, Jian","Forsyth, David","Zhang, Lei"]},{"key":"dc:creator","label":"Author","values":["Zhong, Yuanyi"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-12","2022-12-01"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Deep Learning","Self-supervised Learning","Computer Vision","Reinforcement Learning","Sample Efficiency","Artificial Intelligence"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Yuanyi Zhong"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/117813"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","The student, Yuanyi Zhong, accepted the attached license on 2022-11-30 at 15:32.","The student, Yuanyi Zhong, submitted this Dissertation for approval on 2022-12-01 at 07:17.","This Dissertation was approved for publication on 2022-12-01 at 13:16.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18704 on 2023-04-12 at 07:36:31","Sample efficiency is a crucial aspect of machine learning algorithms. A more sample-efficient algorithm can achieve better performance with less training data. On the other hand, the success of modern machine learning relies heavily on large data samples. For example, a visual recognition system typically needs to be trained on thousands or millions of labeled images to reach good accuracy. In addition, a reinforcement learning agent needs to experience a vast number of environmental interactions to be competitive. With the ever-growing demand for real-world machine learning solutions, it becomes imperative to develop more sample-efficient algorithms that rely less on human annotations or environment interactions and thus can learn more efficiently. Learning from self-supervision has recently emerged as a promising way to improve sample efficiency. The idea is that we can train the model with supervision signals generated not by human annotators or the environment but rather by the carefully constructed self-supervised tasks based on the model itself. In this dissertation, I present my contributions to improving the sample efficiency of machine learning with self-supervision for visual and reinforcement learning problems. The dissertation naturally breaks down into three parts according to the techniques used. The first two parts contain methods designed for vision tasks such as object detection and image segmentation. The core idea is either to leverage pseudo labels generated by an existing model, as in Chapters 2-3, or to leverage the invariance and equivariance property that we know to be inherently true for natural images, as in Chapters 4-6. The third part describes my research projects on building more sample-efficient reinforcement learning algorithms based on the ideas of self-supervised video prediction, self-play against a population, and self-critic with variance reduction as in Chapters 7-9. Altogether, this dissertation demonstrates multiple effective ways to improve the sample efficiency of machine learning across a wide range of tasks and the tremendous potential of self-supervision in the development of future AI systems."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Sample-efficient learning with self-supervision"]}]}],"canonical_facts":{"dc:contributor":["Wang, Yuxiong","Peng, Jian","Forsyth, David","Zhang, Lei"],"dc:creator":["Zhong, Yuanyi"],"dc:date":["2022-12","2022-12-01"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","The student, Yuanyi Zhong, accepted the attached license on 2022-11-30 at 15:32.","The student, Yuanyi Zhong, submitted this Dissertation for approval on 2022-12-01 at 07:17.","This Dissertation was approved for publication on 2022-12-01 at 13:16.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18704 on 2023-04-12 at 07:36:31","Sample efficiency is a crucial aspect of machine learning algorithms. A more sample-efficient algorithm can achieve better performance with less training data. On the other hand, the success of modern machine learning relies heavily on large data samples. For example, a visual recognition system typically needs to be trained on thousands or millions of labeled images to reach good accuracy. In addition, a reinforcement learning agent needs to experience a vast number of environmental interactions to be competitive. With the ever-growing demand for real-world machine learning solutions, it becomes imperative to develop more sample-efficient algorithms that rely less on human annotations or environment interactions and thus can learn more efficiently. Learning from self-supervision has recently emerged as a promising way to improve sample efficiency. The idea is that we can train the model with supervision signals generated not by human annotators or the environment but rather by the carefully constructed self-supervised tasks based on the model itself. In this dissertation, I present my contributions to improving the sample efficiency of machine learning with self-supervision for visual and reinforcement learning problems. The dissertation naturally breaks down into three parts according to the techniques used. The first two parts contain methods designed for vision tasks such as object detection and image segmentation. The core idea is either to leverage pseudo labels generated by an existing model, as in Chapters 2-3, or to leverage the invariance and equivariance property that we know to be inherently true for natural images, as in Chapters 4-6. The third part describes my research projects on building more sample-efficient reinforcement learning algorithms based on the ideas of self-supervised video prediction, self-play against a population, and self-critic with variance reduction as in Chapters 7-9. Altogether, this dissertation demonstrates multiple effective ways to improve the sample efficiency of machine learning across a wide range of tasks and the tremendous potential of self-supervision in the development of future AI systems."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/117813"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Yuanyi Zhong"],"dc:subject":["Deep Learning","Self-supervised Learning","Computer Vision","Reinforcement Learning","Sample Efficiency","Artificial Intelligence"],"dc:title":["Sample-efficient learning with self-supervision"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:56Z"}