{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/125619"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/125619","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Adaptation of Generative Models for Image Manipulation and Recontextualization","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-02-04 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled &#x27;Open Access&#x27;. The submission was exported from vireo on 2025-02-04 without embargo terms","abstract_has_math":false,"creators":["Shah, Viraj"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Lazebnik, Svetlana","Forsyth, David","Schwing, Alexander","Hasegawa-Johnson, Mark"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-07-12","date_published":"2024-07-12","updated_at":"2026-07-22T22:25:02Z","subjects":["Generative Models","Generative Adversarial Networks","Diffusion Models","Image Editing","Image Stylization","Intrinsic Image Decomposition","Recontextualization"],"languages":["en","eng"],"rights":["Copyright 2024 Viraj Shah"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/125619","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Lazebnik, Svetlana","Forsyth, David","Schwing, Alexander","Hasegawa-Johnson, Mark"]},{"key":"dc:creator","label":"Author","values":["Shah, Viraj"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-07-12","2024-08"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Generative Models","Generative Adversarial Networks","Diffusion Models","Image Editing","Image Stylization","Intrinsic Image Decomposition","Recontextualization"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Viraj Shah"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/125619"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-02-04 without embargo terms","The student, Viraj Shah, accepted the attached license on 2024-07-11 at 16:42.","The student, Viraj Shah, submitted this Dissertation for approval on 2024-07-11 at 16:59.","This Dissertation was approved for publication on 2024-07-12 at 15:31.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21076 on 2025-02-04 at 21:05:03","In recent works, generative models such as generative adversarial networks (GANs) and diffusion models have demonstrated a remarkable ability to mimic the image data distributions and to synthesize highly photo-realistic images representing diverse sets of concepts. Such models capture rich semantic information of the image data, and can potentially be used as a prior in solving image manipulation and recontextualization problems. In this work, we aim to study various challenges in employing generative models as priors in solving image attribute editing, intrinsic image decomposition, and one-shot image stylization. First, we discuss the challenge of inverting a pre-trained GAN, a crucial step in exploiting the rich GAN image priors, and how we can achieve a near-perfect GAN Inversion for accurate image reconstruction and attribute editing. We extend the framework of GAN Inversion to multiple GANs that allow for jointly leveraging multiple GAN priors for the successful decomposition of an image into its intrinsic components such as albedo, shading, and specular. Further, we propose a GAN-based one-shot stylization method that can stylize an input image into multiple styles at once while using only one example of each reference style. Since the GAN-based stylization approaches are typically limited to specific subject domains, we also propose a diffusion model-based one-shot stylization approach, ZipLoRA, that allows for generating any subject in any style along with text-driven recontextualization capabilities."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Adaptation of Generative Models for Image Manipulation and Recontextualization"]}]}],"canonical_facts":{"dc:contributor":["Lazebnik, Svetlana","Forsyth, David","Schwing, Alexander","Hasegawa-Johnson, Mark"],"dc:creator":["Shah, Viraj"],"dc:date":["2024-07-12","2024-08"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-02-04 without embargo terms","The student, Viraj Shah, accepted the attached license on 2024-07-11 at 16:42.","The student, Viraj Shah, submitted this Dissertation for approval on 2024-07-11 at 16:59.","This Dissertation was approved for publication on 2024-07-12 at 15:31.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21076 on 2025-02-04 at 21:05:03","In recent works, generative models such as generative adversarial networks (GANs) and diffusion models have demonstrated a remarkable ability to mimic the image data distributions and to synthesize highly photo-realistic images representing diverse sets of concepts. Such models capture rich semantic information of the image data, and can potentially be used as a prior in solving image manipulation and recontextualization problems. In this work, we aim to study various challenges in employing generative models as priors in solving image attribute editing, intrinsic image decomposition, and one-shot image stylization. First, we discuss the challenge of inverting a pre-trained GAN, a crucial step in exploiting the rich GAN image priors, and how we can achieve a near-perfect GAN Inversion for accurate image reconstruction and attribute editing. We extend the framework of GAN Inversion to multiple GANs that allow for jointly leveraging multiple GAN priors for the successful decomposition of an image into its intrinsic components such as albedo, shading, and specular. Further, we propose a GAN-based one-shot stylization method that can stylize an input image into multiple styles at once while using only one example of each reference style. Since the GAN-based stylization approaches are typically limited to specific subject domains, we also propose a diffusion model-based one-shot stylization approach, ZipLoRA, that allows for generating any subject in any style along with text-driven recontextualization capabilities."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/125619"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Viraj Shah"],"dc:subject":["Generative Models","Generative Adversarial Networks","Diffusion Models","Image Editing","Image Stylization","Intrinsic Image Decomposition","Recontextualization"],"dc:title":["Adaptation of Generative Models for Image Manipulation and Recontextualization"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:02Z"}