{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/117767"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/117767","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Soft real time resource management for vision based internet of things systems","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","abstract_has_math":false,"creators":["Yang, Zhe"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Nahrstedt, Klara","Godfrey, Brighten","Xu, Tianyin","Li, Baochun"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-12","date_published":"2022-12","updated_at":"2026-07-22T22:24:56Z","subjects":["Internet Of Things","Computer Vision","Computer Systems","Machine Learning"],"languages":["en","eng"],"rights":["Copyright 2022 Zhe Yang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/117767","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Nahrstedt, Klara","Godfrey, Brighten","Xu, Tianyin","Li, Baochun"]},{"key":"dc:creator","label":"Author","values":["Yang, Zhe"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-12","2022-11-21"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Internet Of Things","Computer Vision","Computer Systems","Machine Learning"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Zhe Yang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/117767"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","The student, Zhe Yang, accepted the attached license on 2022-11-20 at 02:33.","The student, Zhe Yang, submitted this Dissertation for approval on 2022-11-20 at 02:42.","This Dissertation was approved for publication on 2022-11-21 at 14:07.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18600 on 2023-04-12 at 07:29:08","Vision based IoT systems have become ubiquitous today. These systems capture vision data – including images and videos – on cameras and offload data to an edge server or a cloud server for processing. Since cameras produce vision data continuously and the amount of produced data is very large, these vision data are usually consumed by automatic processing procedures including traditional processing techniques and deep learning based processing. Vision based IoT systems have low response time or soft real time processing as their service requirement. However, it is challenging to deliver soft real time services for these systems. First, when multiple cameras are deployed in nearby areas where they contend for network bandwidth, how to schedule network resources for cameras considering bandwidth, latency, and accuracy constraints? Second, when vision data are offloaded to edge or cloud and request to be processed by deep learning based computer vision models, how to schedule the processing of these tasks to deliver soft real time services? Third, for more complicated processing such as workflow processing, how to allocate resources in order to optimize processing response time? This thesis provides soft real time services for vision based IoT systems by tackling the above three challenges. Our thesis statement is: In vision based IoT systems, machine learning - system co-design is necessary to deliver soft real time services. We prove this statement by presenting a framework providing soft real time resource management for vision based IoT systems. This framework has three facets. First, we present a network bandwidth efficient streaming system which schedules network resources for vision based IoT applications when they offload vision data to edge or cloud to be processed by computer vision models. Machine learning based video processing techniques are employed to extract semantic information and reduce the amount of data to offload. With our ML - system co-design, we improve streaming utility by up to 23% compared to baselines when providing soft real time video analytics. Second, when vision data are offloaded to edge or cloud, a heuristics based soft real time GPU scheduler is presented to schedule the execution of computer vision workloads. With the ML - system co-design, our scheduler is able to greatly decrease deadline miss rates for computer vision applications run on the edge GPU. Third, as for more complicated processing involving workflows, we present a reinforcement learning based resource management framework to optimize workflow request response time. The ML - system co-design provides low response time services for complicated workflow processing on the cloud."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Soft real time resource management for vision based internet of things systems"]}]}],"canonical_facts":{"dc:contributor":["Nahrstedt, Klara","Godfrey, Brighten","Xu, Tianyin","Li, Baochun"],"dc:creator":["Yang, Zhe"],"dc:date":["2022-12","2022-11-21"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","The student, Zhe Yang, accepted the attached license on 2022-11-20 at 02:33.","The student, Zhe Yang, submitted this Dissertation for approval on 2022-11-20 at 02:42.","This Dissertation was approved for publication on 2022-11-21 at 14:07.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18600 on 2023-04-12 at 07:29:08","Vision based IoT systems have become ubiquitous today. These systems capture vision data – including images and videos – on cameras and offload data to an edge server or a cloud server for processing. Since cameras produce vision data continuously and the amount of produced data is very large, these vision data are usually consumed by automatic processing procedures including traditional processing techniques and deep learning based processing. Vision based IoT systems have low response time or soft real time processing as their service requirement. However, it is challenging to deliver soft real time services for these systems. First, when multiple cameras are deployed in nearby areas where they contend for network bandwidth, how to schedule network resources for cameras considering bandwidth, latency, and accuracy constraints? Second, when vision data are offloaded to edge or cloud and request to be processed by deep learning based computer vision models, how to schedule the processing of these tasks to deliver soft real time services? Third, for more complicated processing such as workflow processing, how to allocate resources in order to optimize processing response time? This thesis provides soft real time services for vision based IoT systems by tackling the above three challenges. Our thesis statement is: In vision based IoT systems, machine learning - system co-design is necessary to deliver soft real time services. We prove this statement by presenting a framework providing soft real time resource management for vision based IoT systems. This framework has three facets. First, we present a network bandwidth efficient streaming system which schedules network resources for vision based IoT applications when they offload vision data to edge or cloud to be processed by computer vision models. Machine learning based video processing techniques are employed to extract semantic information and reduce the amount of data to offload. With our ML - system co-design, we improve streaming utility by up to 23% compared to baselines when providing soft real time video analytics. Second, when vision data are offloaded to edge or cloud, a heuristics based soft real time GPU scheduler is presented to schedule the execution of computer vision workloads. With the ML - system co-design, our scheduler is able to greatly decrease deadline miss rates for computer vision applications run on the edge GPU. Third, as for more complicated processing involving workflows, we present a reinforcement learning based resource management framework to optimize workflow request response time. The ML - system co-design provides low response time services for complicated workflow processing on the cloud."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/117767"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Zhe Yang"],"dc:subject":["Internet Of Things","Computer Vision","Computer Systems","Machine Learning"],"dc:title":["Soft real time resource management for vision based internet of things systems"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:56Z"}