{"id":{"repo_id":"unsw","oai_identifier":"oai:unsworks.library.unsw.edu.au:1959.4/105642"},"canonical_url":"https://search.dev.ndltd.org/etd/unsw/oai:unsworks.library.unsw.edu.au:1959.4/105642","repository":{"repo_id":"unsw","name":"University of New South Wales","base_url":"https://unsworks.unsw.edu.au/oai/provider"},"display":{"title":"Efficient Deep Learning: Model Design and Algorithmic Innovation","abstract":"The rapid evolution of Artificial Intelligence (AI) and Deep Learning (DL) has revolutionized numerous domains, from computer vision to natural language processing and intelligent recommendation systems. However, this progress has been accompanied by escalating computational demands that challenge the scalability and practical deployment of modern AI systems. This thesis addresses these efficiency challenges through an integrated approach, introducing novel methodologies that co-optimize performance and resource utilization in model design, training, and deployment. Central to this research is the development of advanced Neural Architecture Search (NAS) frameworks. These frameworks enable the automated design of lightweight, task-specific neural networks optimized for resource-constrained scenarios, such as mobile devices and edge computing environments. By employing a semi-supervised NAS strategy, the thesis demonstrates how efficient models can be designed with minimal labeled data, addressing the prevalent challenge of data scarcity in real-world applications. The proposed methods facilitate adaptation to diverse hardware platforms, ensuring high performance while adhering to strict latency, memory, and energy constraints. In addition to model design, the thesis explores the efficiency of generative models, a rapidly growing area of DL research. Novel contributions include hierarchical latent space optimization techniques that accelerate the image generation process and conditional diffusion mechanisms tailored for recommendation systems. These advancements streamline the generative workflows, significantly reducing computational overhead while maintaining state-of-the-art accuracy and output quality. Furthermore, the research introduces segment-wise NAS techniques, which dynamically allocate computational resources across different stages of the diffusion process, achieving optimal efficiency without sacrificing performance. This research offers significant contributions to the field of efficient AI, bridging the gap between cutting-edge algorithmic innovations and practical, resource-aware deployment strategies. It highlights the need for holistic design principles that prioritize both accuracy and efficiency, ensuring the scalability and sustainability of AI in an increasingly resource-constrained world. The findings of this thesis are validated through extensive experimentation on diverse benchmarks.","abstract_html":"The rapid evolution of Artificial Intelligence (AI) and Deep Learning (DL) has revolutionized numerous domains, from computer vision to natural language processing and intelligent recommendation systems. However, this progress has been accompanied by escalating computational demands that challenge the scalability and practical deployment of modern AI systems. This thesis addresses these efficiency challenges through an integrated approach, introducing novel methodologies that co-optimize performance and resource utilization in model design, training, and deployment. Central to this research is the development of advanced Neural Architecture Search (NAS) frameworks. These frameworks enable the automated design of lightweight, task-specific neural networks optimized for resource-constrained scenarios, such as mobile devices and edge computing environments. By employing a semi-supervised NAS strategy, the thesis demonstrates how efficient models can be designed with minimal labeled data, addressing the prevalent challenge of data scarcity in real-world applications. The proposed methods facilitate adaptation to diverse hardware platforms, ensuring high performance while adhering to strict latency, memory, and energy constraints. In addition to model design, the thesis explores the efficiency of generative models, a rapidly growing area of DL research. Novel contributions include hierarchical latent space optimization techniques that accelerate the image generation process and conditional diffusion mechanisms tailored for recommendation systems. These advancements streamline the generative workflows, significantly reducing computational overhead while maintaining state-of-the-art accuracy and output quality. Furthermore, the research introduces segment-wise NAS techniques, which dynamically allocate computational resources across different stages of the diffusion process, achieving optimal efficiency without sacrificing performance. This research offers significant contributions to the field of efficient AI, bridging the gap between cutting-edge algorithmic innovations and practical, resource-aware deployment strategies. It highlights the need for holistic design principles that prioritize both accuracy and efficiency, ensuring the scalability and sustainability of AI in an increasingly resource-constrained world. The findings of this thesis are validated through extensive experimentation on diverse benchmarks.","abstract_has_math":false,"creators":["Huang, Hongtao"],"institution":"UNSW, Sydney","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025","date_published":"2025","updated_at":"2026-07-24T05:33:06Z","subjects":["Resource-efficient Deep Learning","anzsrc-for: 46 INFORMATION AND COMPUTING SCIENCES"],"languages":["en"],"rights":["open access","CC BY 4.0","free_to_read"],"rights_urls":["https://purl.org/coar/access_right/c_abf2","https://creativecommons.org/licenses/by/4.0/"],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["https://doi.org/10.26190/unsworks/31524"],"render_values":[{"text":"https://doi.org/10.26190/unsworks/31524","href":"https://doi.org/10.26190/unsworks/31524","code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/1959.4/105642","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Huang, Hongtao"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025"]},{"key":"dc:publisher","label":"Institution","values":["UNSW, Sydney"]},{"key":"dc:type","label":"Dc Type","values":["doctoral thesis","http://purl.org/coar/resource_type/c_db06"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Resource-efficient Deep Learning","anzsrc-for: 46 INFORMATION AND COMPUTING SCIENCES"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["open access","https://purl.org/coar/access_right/c_abf2","CC BY 4.0","https://creativecommons.org/licenses/by/4.0/","free_to_read"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/1959.4/105642","https://unsworks.unsw.edu.au/bitstreams/172480c1-c1da-4bb1-b3cf-d60d52f3a36a/download","https://doi.org/10.26190/unsworks/31524"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The rapid evolution of Artificial Intelligence (AI) and Deep Learning (DL) has revolutionized numerous domains, from computer vision to natural language processing and intelligent recommendation systems. However, this progress has been accompanied by escalating computational demands that challenge the scalability and practical deployment of modern AI systems. This thesis addresses these efficiency challenges through an integrated approach, introducing novel methodologies that co-optimize performance and resource utilization in model design, training, and deployment. Central to this research is the development of advanced Neural Architecture Search (NAS) frameworks. These frameworks enable the automated design of lightweight, task-specific neural networks optimized for resource-constrained scenarios, such as mobile devices and edge computing environments. By employing a semi-supervised NAS strategy, the thesis demonstrates how efficient models can be designed with minimal labeled data, addressing the prevalent challenge of data scarcity in real-world applications. The proposed methods facilitate adaptation to diverse hardware platforms, ensuring high performance while adhering to strict latency, memory, and energy constraints. In addition to model design, the thesis explores the efficiency of generative models, a rapidly growing area of DL research. Novel contributions include hierarchical latent space optimization techniques that accelerate the image generation process and conditional diffusion mechanisms tailored for recommendation systems. These advancements streamline the generative workflows, significantly reducing computational overhead while maintaining state-of-the-art accuracy and output quality. Furthermore, the research introduces segment-wise NAS techniques, which dynamically allocate computational resources across different stages of the diffusion process, achieving optimal efficiency without sacrificing performance. This research offers significant contributions to the field of efficient AI, bridging the gap between cutting-edge algorithmic innovations and practical, resource-aware deployment strategies. It highlights the need for holistic design principles that prioritize both accuracy and efficiency, ensuring the scalability and sustainability of AI in an increasingly resource-constrained world. The findings of this thesis are validated through extensive experimentation on diverse benchmarks."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Efficient Deep Learning: Model Design and Algorithmic Innovation"]}]}],"canonical_facts":{"dc:creator":["Huang, Hongtao"],"dc:date":["2025"],"dc:description":["The rapid evolution of Artificial Intelligence (AI) and Deep Learning (DL) has revolutionized numerous domains, from computer vision to natural language processing and intelligent recommendation systems. However, this progress has been accompanied by escalating computational demands that challenge the scalability and practical deployment of modern AI systems. This thesis addresses these efficiency challenges through an integrated approach, introducing novel methodologies that co-optimize performance and resource utilization in model design, training, and deployment. Central to this research is the development of advanced Neural Architecture Search (NAS) frameworks. These frameworks enable the automated design of lightweight, task-specific neural networks optimized for resource-constrained scenarios, such as mobile devices and edge computing environments. By employing a semi-supervised NAS strategy, the thesis demonstrates how efficient models can be designed with minimal labeled data, addressing the prevalent challenge of data scarcity in real-world applications. The proposed methods facilitate adaptation to diverse hardware platforms, ensuring high performance while adhering to strict latency, memory, and energy constraints. In addition to model design, the thesis explores the efficiency of generative models, a rapidly growing area of DL research. Novel contributions include hierarchical latent space optimization techniques that accelerate the image generation process and conditional diffusion mechanisms tailored for recommendation systems. These advancements streamline the generative workflows, significantly reducing computational overhead while maintaining state-of-the-art accuracy and output quality. Furthermore, the research introduces segment-wise NAS techniques, which dynamically allocate computational resources across different stages of the diffusion process, achieving optimal efficiency without sacrificing performance. This research offers significant contributions to the field of efficient AI, bridging the gap between cutting-edge algorithmic innovations and practical, resource-aware deployment strategies. It highlights the need for holistic design principles that prioritize both accuracy and efficiency, ensuring the scalability and sustainability of AI in an increasingly resource-constrained world. The findings of this thesis are validated through extensive experimentation on diverse benchmarks."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/1959.4/105642","https://unsworks.unsw.edu.au/bitstreams/172480c1-c1da-4bb1-b3cf-d60d52f3a36a/download","https://doi.org/10.26190/unsworks/31524"],"dc:language":["en"],"dc:publisher":["UNSW, Sydney"],"dc:rights":["open access","https://purl.org/coar/access_right/c_abf2","CC BY 4.0","https://creativecommons.org/licenses/by/4.0/","free_to_read"],"dc:subject":["Resource-efficient Deep Learning","anzsrc-for: 46 INFORMATION AND COMPUTING SCIENCES"],"dc:title":["Efficient Deep Learning: Model Design and Algorithmic Innovation"],"dc:type":["doctoral thesis","http://purl.org/coar/resource_type/c_db06"]},"updated_at":"2026-07-24T05:33:06Z"}