{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/129530"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/129530","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Resource-efficient optimizations of 3D vision models for segmentation and detection","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","abstract_has_math":false,"creators":["Zheng, Hongbo"],"institution":"University of Illinois Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Zhang, Minjia"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-04-15","date_published":"2025-04-15","updated_at":"2026-07-22T22:25:05Z","subjects":["3D Vision","Resource-Efficient Deep Learning","Volumetric Medical Image Segmentation","In-Place Operation","LiDAR-based 3D Object Detection","Post-Training Quantization (PTQ)","Training-Free Quantization (TFQ)","Mixed-Precision Inference"],"languages":["en","eng"],"rights":["Copyright 2025 Hongbo Zheng All rights reserved."],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/129530","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Zhang, Minjia"]},{"key":"dc:creator","label":"Author","values":["Zheng, Hongbo"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-04-15","2025-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["3D Vision","Resource-Efficient Deep Learning","Volumetric Medical Image Segmentation","In-Place Operation","LiDAR-based 3D Object Detection","Post-Training Quantization (PTQ)","Training-Free Quantization (TFQ)","Mixed-Precision Inference"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Hongbo Zheng All rights reserved."]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/129530"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","The student, Hongbo Zheng, accepted the attached license on 2025-04-15 at 10:50.","The student, Hongbo Zheng, submitted this Thesis for approval on 2025-04-15 at 11:18.","This Thesis was approved for publication on 2025-04-15 at 12:42.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21776 on 2025-10-19 at 19:14:56","The growing deployment of deep learning models in real-world 3D vision applications, ranging from medical image segmentation to autonomous perception, demands solutions that are not only accurate but also computationally and memory efficient. However, the resource intensity of 3D models presents persistent challenges at both ends of the deployment pipeline, particularly during training and inference. This thesis addresses these two critical bottlenecks with a unified objective: to improve the efficiency and scalability of 3D vision systems under real-world constraints. We begin by examining the shared computational challenges faced by 3D models, including high-dimensional input, constrained batch sizes, prolonged training times, and the need for low-latency, high-throughput inference on edge devices. Using volumetric medical imaging and LiDAR-based 3D object detection as case studies, we identify common structural and performance limitations and develop domain-adaptive optimization techniques. To mitigate training-time memory overhead, we employ an in-place normalization strategy that replaces conventional normalization layers (e.g., \\texttt{BatchNorm3d}, \\texttt{InstanceNorm3d}) with memory-efficient in-place variants. This technique reduces activation memory consumption without altering model behavior, enabling larger batch sizes and improved throughput. We validate the approach through theoretical gradient correctness analysis and empirical evaluations on representative 3D medical imaging models, including LHU-Net and 3D Res-UNet, across high-resolution volumetric datasets such as the Brain Tumor Segmentation Challenge (BraTS), the Left Atrial dataset (LA), and the NIH pancreas dataset (CT-82). For inference-time optimization, we introduce \\qlidar, a training-free and calibration-free quantization framework designed to address the structural heterogeneity of modern 3D LiDAR object detection models. \\qlidar incorporates \\smoothconv and fine-grained channel-wise quantization to effectively compress a diverse set of model components, including 1D/2D convolutions (Conv1d/2d), sparse convolutions (SPConv), submanifold convolutions (SubMConv), and multi-layer perceptrons (MLP). By eliminating the need for retraining or calibration data, \\qlidar achieves high compression ratios while maintaining competitive accuracy under mixed-precision settings (W4A8 and W8A8) across standard benchmarks, including Waymo, nuScenes, and KITTI datasets. Collectively, these contributions advance the design of efficient and scalable 3D vision models by addressing critical training and inference inefficiencies. By bridging memory-aware learning with deployment-aware quantization, this thesis lays the groundwork for future 3D vision systems that are not only high-performing but also resource-efficient and deployment-ready."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Resource-efficient optimizations of 3D vision models for segmentation and detection"]}]}],"canonical_facts":{"dc:contributor":["Zhang, Minjia"],"dc:creator":["Zheng, Hongbo"],"dc:date":["2025-04-15","2025-05"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","The student, Hongbo Zheng, accepted the attached license on 2025-04-15 at 10:50.","The student, Hongbo Zheng, submitted this Thesis for approval on 2025-04-15 at 11:18.","This Thesis was approved for publication on 2025-04-15 at 12:42.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21776 on 2025-10-19 at 19:14:56","The growing deployment of deep learning models in real-world 3D vision applications, ranging from medical image segmentation to autonomous perception, demands solutions that are not only accurate but also computationally and memory efficient. However, the resource intensity of 3D models presents persistent challenges at both ends of the deployment pipeline, particularly during training and inference. This thesis addresses these two critical bottlenecks with a unified objective: to improve the efficiency and scalability of 3D vision systems under real-world constraints. We begin by examining the shared computational challenges faced by 3D models, including high-dimensional input, constrained batch sizes, prolonged training times, and the need for low-latency, high-throughput inference on edge devices. Using volumetric medical imaging and LiDAR-based 3D object detection as case studies, we identify common structural and performance limitations and develop domain-adaptive optimization techniques. To mitigate training-time memory overhead, we employ an in-place normalization strategy that replaces conventional normalization layers (e.g., \\texttt{BatchNorm3d}, \\texttt{InstanceNorm3d}) with memory-efficient in-place variants. This technique reduces activation memory consumption without altering model behavior, enabling larger batch sizes and improved throughput. We validate the approach through theoretical gradient correctness analysis and empirical evaluations on representative 3D medical imaging models, including LHU-Net and 3D Res-UNet, across high-resolution volumetric datasets such as the Brain Tumor Segmentation Challenge (BraTS), the Left Atrial dataset (LA), and the NIH pancreas dataset (CT-82). For inference-time optimization, we introduce \\qlidar, a training-free and calibration-free quantization framework designed to address the structural heterogeneity of modern 3D LiDAR object detection models. \\qlidar incorporates \\smoothconv and fine-grained channel-wise quantization to effectively compress a diverse set of model components, including 1D/2D convolutions (Conv1d/2d), sparse convolutions (SPConv), submanifold convolutions (SubMConv), and multi-layer perceptrons (MLP). By eliminating the need for retraining or calibration data, \\qlidar achieves high compression ratios while maintaining competitive accuracy under mixed-precision settings (W4A8 and W8A8) across standard benchmarks, including Waymo, nuScenes, and KITTI datasets. Collectively, these contributions advance the design of efficient and scalable 3D vision models by addressing critical training and inference inefficiencies. By bridging memory-aware learning with deployment-aware quantization, this thesis lays the groundwork for future 3D vision systems that are not only high-performing but also resource-efficient and deployment-ready."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/129530"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Hongbo Zheng All rights reserved."],"dc:subject":["3D Vision","Resource-Efficient Deep Learning","Volumetric Medical Image Segmentation","In-Place Operation","LiDAR-based 3D Object Detection","Post-Training Quantization (PTQ)","Training-Free Quantization (TFQ)","Mixed-Precision Inference"],"dc:title":["Resource-efficient optimizations of 3D vision models for segmentation and detection"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:05Z"}