{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/129917"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/129917","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Enhancing multi-label object recognition in complex images via region-based continual learning","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","abstract_has_math":false,"creators":["Chatikyan, Elen"],"institution":"University of Illinois Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Hoiem, Derek W."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-07-18","date_published":"2025-07-18","updated_at":"2026-07-22T22:25:06Z","subjects":["Multi-label Object Recognition","Region-based Learning","Continual Learning","Computer Vision","Weak Supervision","Clip","Dinov2","Segmentation Masks","Negative Sampling","Open-vocabulary Classification","Sam","Binary Cross-entropy Loss","Image-level Supervision","Coco Dataset","Vision-language Models"],"languages":["en","eng"],"rights":["Copyright 2025 Elen Chatikyan"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/129917","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Hoiem, Derek W."]},{"key":"dc:creator","label":"Author","values":["Chatikyan, Elen"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-07-18","2025-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Multi-label Object Recognition","Region-based Learning","Continual Learning","Computer Vision","Weak Supervision","Clip","Dinov2","Segmentation Masks","Negative Sampling","Open-vocabulary Classification","Sam","Binary Cross-entropy Loss","Image-level Supervision","Coco Dataset","Vision-language Models"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Elen Chatikyan"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/129917"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","The student, Elen Chatikyan, accepted the attached license on 2025-07-15 at 16:48.","The student, Elen Chatikyan, submitted this Thesis for approval on 2025-07-15 at 17:01.","This Thesis was approved for publication on 2025-07-18 at 14:56.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22404 on 2025-10-20 at 20:14:55","This thesis explores a region-based continual learning approach for multi-label object recognition in complex, multi-object scenes, designed to facilitate efficient learning from limited region-level supervision. We build on the AnytimeCL framework [1] by adapting it to a region-aware, multi-label setting. Our approach supports fine-grained learning with limited supervision by training on object-level regions from a controlled, balanced subset of the COCO dataset (14,000 images). Rather than emphasizing extremely low-shot scenarios at this stage, we focus on validating the effectiveness of region-based learning in improving multi-label object detection under moderate supervision. Investigating whether similar gains hold in extremely low-shot settings (e.g., 15–20 examples per class) is left for future work. To improve region-level predictions, we incorporate value-projected features from the final layers of transformer models, following the method proposed by Xiao et al. in their TextRegion work [2], which enhances class-specific region alignment. Our system combines vision-language features from CLIP and DINOv2, utilizing binary cross-entropy loss to support multi-label classification. To strengthen learning under limited supervision, we incorporate negative sampling at both the region and label levels. Areas corresponding to background or unrelated objects are treated as negatives, while unannotated classes are treated as negative labels. Annotated classes are ignored outside their corresponding regions. As a result, the model focuses on fine-grained object representations without requiring dense annotations. At inference time, we employ the Segment Anything Model (SAM)~\\cite{kirillov2023segment} with a filtering layer to propose candidate object regions in unannotated images. This enables scalable, region-level predictions without requiring inference-time annotations. We evaluate our approach on a subset of the COCO dataset~\\cite{lin2014microsoft}, using both region-level and image-level metrics, including Top-1 accuracy, F1 score, mean average precision (mAP), and subset accuracy. Our findings highlight the effectiveness of combining region-level learning with negative sampling for scalable, fine-grained multi-label recognition under limited supervision."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Enhancing multi-label object recognition in complex images via region-based continual learning"]}]}],"canonical_facts":{"dc:contributor":["Hoiem, Derek W."],"dc:creator":["Chatikyan, Elen"],"dc:date":["2025-07-18","2025-08"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","The student, Elen Chatikyan, accepted the attached license on 2025-07-15 at 16:48.","The student, Elen Chatikyan, submitted this Thesis for approval on 2025-07-15 at 17:01.","This Thesis was approved for publication on 2025-07-18 at 14:56.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22404 on 2025-10-20 at 20:14:55","This thesis explores a region-based continual learning approach for multi-label object recognition in complex, multi-object scenes, designed to facilitate efficient learning from limited region-level supervision. We build on the AnytimeCL framework [1] by adapting it to a region-aware, multi-label setting. Our approach supports fine-grained learning with limited supervision by training on object-level regions from a controlled, balanced subset of the COCO dataset (14,000 images). Rather than emphasizing extremely low-shot scenarios at this stage, we focus on validating the effectiveness of region-based learning in improving multi-label object detection under moderate supervision. Investigating whether similar gains hold in extremely low-shot settings (e.g., 15–20 examples per class) is left for future work. To improve region-level predictions, we incorporate value-projected features from the final layers of transformer models, following the method proposed by Xiao et al. in their TextRegion work [2], which enhances class-specific region alignment. Our system combines vision-language features from CLIP and DINOv2, utilizing binary cross-entropy loss to support multi-label classification. To strengthen learning under limited supervision, we incorporate negative sampling at both the region and label levels. Areas corresponding to background or unrelated objects are treated as negatives, while unannotated classes are treated as negative labels. Annotated classes are ignored outside their corresponding regions. As a result, the model focuses on fine-grained object representations without requiring dense annotations. At inference time, we employ the Segment Anything Model (SAM)~\\cite{kirillov2023segment} with a filtering layer to propose candidate object regions in unannotated images. This enables scalable, region-level predictions without requiring inference-time annotations. We evaluate our approach on a subset of the COCO dataset~\\cite{lin2014microsoft}, using both region-level and image-level metrics, including Top-1 accuracy, F1 score, mean average precision (mAP), and subset accuracy. Our findings highlight the effectiveness of combining region-level learning with negative sampling for scalable, fine-grained multi-label recognition under limited supervision."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/129917"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Elen Chatikyan"],"dc:subject":["Multi-label Object Recognition","Region-based Learning","Continual Learning","Computer Vision","Weak Supervision","Clip","Dinov2","Segmentation Masks","Negative Sampling","Open-vocabulary Classification","Sam","Binary Cross-entropy Loss","Image-level Supervision","Coco Dataset","Vision-language Models"],"dc:title":["Enhancing multi-label object recognition in complex images via region-based continual learning"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:06Z"}