{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/104944"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/104944","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Deep intelligence as a service: A real-time scheduling perspective","abstract":"\"This thesis presents a new type of cloud service, called {\\em deep intelligence as a service\\/}, that is expected to become increasingly common in the near future to support emerging \"\"smart\"\" embedded applications. This work offers a real-time scheduling model motivated by the special needs of embedded applications that use this service. A simple run-time scheduler is proposed for the server and prove an approximation bound in terms of application-perceived service utility. The service is implemented on representative device hardware and tested with a machine vision application illustrating the advantages of our scheme. The work is motivated by the proliferation of increasingly ubiquitous but resource-constrained embedded devices (often referred to as the Internet of Things -- IoT -- devices) and the growing desire to endow them with advanced interaction capabilities, such as voice recognition or machine vision. The trend suggests that machine intelligence will be increasingly offloaded to cloud or edge services that will offer advanced capabilities to the otherwise simple devices. New services will feature farms of complex trainable (or pre-trained) classifiers that client-side applications can send data to in order to gain certain types of advanced functionality, such as face recognition, voice command recognition, gesture recognition, or other. These new services will revolutionize human interaction with their physical environment, but may impose interesting real-time scheduling challenges in order to maintain responsiveness while maximizing service quality. This work includes challenges, designs for an efficient real-time scheduling algorithm for the new machine intelligence service, and evaluation on an implemented prototype.\"","abstract_html":""This thesis presents a new type of cloud service, called {\\em deep intelligence as a service\\/}, that is expected to become increasingly common in the near future to support emerging ""smart"" embedded applications. This work offers a real-time scheduling model motivated by the special needs of embedded applications that use this service. A simple run-time scheduler is proposed for the server and prove an approximation bound in terms of application-perceived service utility. The service is implemented on representative device hardware and tested with a machine vision application illustrating the advantages of our scheme. The work is motivated by the proliferation of increasingly ubiquitous but resource-constrained embedded devices (often referred to as the Internet of Things -- IoT -- devices) and the growing desire to endow them with advanced interaction capabilities, such as voice recognition or machine vision. The trend suggests that machine intelligence will be increasingly offloaded to cloud or edge services that will offer advanced capabilities to the otherwise simple devices. New services will feature farms of complex trainable (or pre-trained) classifiers that client-side applications can send data to in order to gain certain types of advanced functionality, such as face recognition, voice command recognition, gesture recognition, or other. These new services will revolutionize human interaction with their physical environment, but may impose interesting real-time scheduling challenges in order to maintain responsiveness while maximizing service quality. This work includes challenges, designs for an efficient real-time scheduling algorithm for the new machine intelligence service, and evaluation on an implemented prototype."","abstract_has_math":false,"creators":["Hao, Yifan"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Abdelzaher, Tarek F."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019-08-23T20:05:23Z","date_published":"2019-08-23T20:05:23Z","updated_at":"2026-07-22T22:24:42Z","subjects":["real-time","IoT","scheduling","deep learning"],"languages":["en"],"rights":["Copyright 2019 Yifan Hao"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/104944","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Abdelzaher, Tarek F."]},{"key":"dc:creator","label":"Author","values":["Hao, Yifan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2019-08-23T20:05:23Z","2019-04-26","2019-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["real-time","IoT","scheduling","deep learning"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2019 Yifan Hao"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/104944"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["\"This thesis presents a new type of cloud service, called {\\em deep intelligence as a service\\/}, that is expected to become increasingly common in the near future to support emerging \"\"smart\"\" embedded applications. This work offers a real-time scheduling model motivated by the special needs of embedded applications that use this service. A simple run-time scheduler is proposed for the server and prove an approximation bound in terms of application-perceived service utility. The service is implemented on representative device hardware and tested with a machine vision application illustrating the advantages of our scheme. The work is motivated by the proliferation of increasingly ubiquitous but resource-constrained embedded devices (often referred to as the Internet of Things -- IoT -- devices) and the growing desire to endow them with advanced interaction capabilities, such as voice recognition or machine vision. The trend suggests that machine intelligence will be increasingly offloaded to cloud or edge services that will offer advanced capabilities to the otherwise simple devices. New services will feature farms of complex trainable (or pre-trained) classifiers that client-side applications can send data to in order to gain certain types of advanced functionality, such as face recognition, voice command recognition, gesture recognition, or other. These new services will revolutionize human interaction with their physical environment, but may impose interesting real-time scheduling challenges in order to maintain responsiveness while maximizing service quality. This work includes challenges, designs for an efficient real-time scheduling algorithm for the new machine intelligence service, and evaluation on an implemented prototype.\"","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2019-08-22 without embargo terms","The student, Yifan Hao, accepted the attached license on 2019-04-25 at 16:46.","The student, Yifan Hao, submitted this Thesis for approval on 2019-04-25 at 16:50.","This Thesis was approved for publication on 2019-04-26 at 11:01.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13929 on 2019-08-22 at 14:47:02","Made available in DSpace on 2019-08-23T20:05:23Z (GMT). No. of bitstreams: 2 HAO-THESIS-2019.pdf: 4048283 bytes, checksum: deee41e8c1aa7900def3d407a8e75873 (MD5) LICENSE.txt: 4206 bytes, checksum: 7feec52b47138425649e4e71380494e9 (MD5) Previous issue date: 2019-04-26"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Deep intelligence as a service: A real-time scheduling perspective"]}]}],"canonical_facts":{"dc:contributor":["Abdelzaher, Tarek F."],"dc:creator":["Hao, Yifan"],"dc:date":["2019-08-23T20:05:23Z","2019-04-26","2019-05"],"dc:description":["\"This thesis presents a new type of cloud service, called {\\em deep intelligence as a service\\/}, that is expected to become increasingly common in the near future to support emerging \"\"smart\"\" embedded applications. This work offers a real-time scheduling model motivated by the special needs of embedded applications that use this service. A simple run-time scheduler is proposed for the server and prove an approximation bound in terms of application-perceived service utility. The service is implemented on representative device hardware and tested with a machine vision application illustrating the advantages of our scheme. The work is motivated by the proliferation of increasingly ubiquitous but resource-constrained embedded devices (often referred to as the Internet of Things -- IoT -- devices) and the growing desire to endow them with advanced interaction capabilities, such as voice recognition or machine vision. The trend suggests that machine intelligence will be increasingly offloaded to cloud or edge services that will offer advanced capabilities to the otherwise simple devices. New services will feature farms of complex trainable (or pre-trained) classifiers that client-side applications can send data to in order to gain certain types of advanced functionality, such as face recognition, voice command recognition, gesture recognition, or other. These new services will revolutionize human interaction with their physical environment, but may impose interesting real-time scheduling challenges in order to maintain responsiveness while maximizing service quality. This work includes challenges, designs for an efficient real-time scheduling algorithm for the new machine intelligence service, and evaluation on an implemented prototype.\"","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2019-08-22 without embargo terms","The student, Yifan Hao, accepted the attached license on 2019-04-25 at 16:46.","The student, Yifan Hao, submitted this Thesis for approval on 2019-04-25 at 16:50.","This Thesis was approved for publication on 2019-04-26 at 11:01.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13929 on 2019-08-22 at 14:47:02","Made available in DSpace on 2019-08-23T20:05:23Z (GMT). No. of bitstreams: 2 HAO-THESIS-2019.pdf: 4048283 bytes, checksum: deee41e8c1aa7900def3d407a8e75873 (MD5) LICENSE.txt: 4206 bytes, checksum: 7feec52b47138425649e4e71380494e9 (MD5) Previous issue date: 2019-04-26"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/104944"],"dc:language":["en"],"dc:rights":["Copyright 2019 Yifan Hao"],"dc:subject":["real-time","IoT","scheduling","deep learning"],"dc:title":["Deep intelligence as a service: A real-time scheduling perspective"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:42Z"}