{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/115757"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/115757","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Viewing enhancement of 360◦ videos in diverse contexts","abstract":"Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-05-01","abstract_html":"Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-05-01","abstract_has_math":false,"creators":["Sarkar, Ayush Guha"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Nahrstedt, Klara"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-05","date_published":"2022-05","updated_at":"2026-07-22T22:24:55Z","subjects":["360◦ video","video streaming","super-resolution","edge computing","bandwidth","latency","firefighting","object detection"],"languages":["en","eng"],"rights":["Copyright 2022 Ayush Sarkar"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/115757","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Nahrstedt, Klara"]},{"key":"dc:creator","label":"Author","values":["Sarkar, Ayush Guha"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-05","2022-04-28"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["360◦ video","video streaming","super-resolution","edge computing","bandwidth","latency","firefighting","object detection"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Ayush Sarkar"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/115757"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-05-01","The student, Ayush Sarkar, accepted the attached license on 2022-04-27 at 23:01.","The student, Ayush Sarkar, submitted this Thesis for approval on 2022-04-27 at 23:25.","This Thesis was approved for publication on 2022-04-28 at 13:09.","DSpace SAF Submission Ingestion Package generated from Vireo submission #17991 on 2022-11-11 at 12:58:17","360◦ videos have revolutionized the way we perceive multimedia content. However, 2D videos still remain the standard, with many file formats, algorithms, and approaches structured for and compliant with 2D formats. 360◦ videos, in general, face difficulties when applied to these established 2D frameworks. For example, convolutional neural networks (CNNs) are trained on images taken from cameras that rely on a perspective projection model, and thus cannot be easily applied to 360◦ imagery, which relies on spherical formats. In this thesis, we look to enhance the viewing experience in two diverse contexts that rely on 360◦ experiences. We look to relax computational challenges from 360◦ formats in these diverse contexts by exploring ways in which we can bridge the gap between CNN applications tailored to the 2D space and 360◦ imagery. In the first context, we look at 360◦ video streaming scenarios. 360◦ videos are of higher resolutions than 2D videos, causing greater bandwidth consumption when streamed and straining the network capacity of cloud providers. To address this problem, we introduce L3BOU, a novel, three-tier distributed software framework that reduces cloud-edge bandwidth in the backhaul network and lowers average end-to-end latency for 360◦ video streaming applications. The L3BOU framework leverages edge-based, optimized upscaling techniques. L3BOU utilizes downscaled MPEG-DASH-encoded 360◦ video data, known as Ultra Low Resolution (ULR) data, that the L3BOU edge applies distributed super-resolution techniques on, providing a high quality video to the client. For the second context, we pivot towards the emergency response domain. Demonstrating firefighting operations in search and rescue missions through videos is a common approach to in-classroom firefighter training. Unfortunately, traditional 2D cameras have fundamental weaknesses – they can only capture a narrow field of view and miss a lot of information coming from the surroundings of the firefighter. Therefore, we propose a system combining the advantage of 360◦ videos and deep learning to automatically detect important objects in the panoramic scene, assisting firefighting instructors in classroom teaching scenarios. Specifically, we summarize the salient objects and events relevant to firefighting through an interview with an experienced firefighting instructor. Leveraging this knowledge, we investigate the detection of firefighting objects on 360◦ videos through a transfer learning approach. We report insightful results for object detectors trained on generic objects and 2D videos and discuss the next steps in designing a customized object detector."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Viewing enhancement of 360◦ videos in diverse contexts"]}]}],"canonical_facts":{"dc:contributor":["Nahrstedt, Klara"],"dc:creator":["Sarkar, Ayush Guha"],"dc:date":["2022-05","2022-04-28"],"dc:description":["Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-05-01","The student, Ayush Sarkar, accepted the attached license on 2022-04-27 at 23:01.","The student, Ayush Sarkar, submitted this Thesis for approval on 2022-04-27 at 23:25.","This Thesis was approved for publication on 2022-04-28 at 13:09.","DSpace SAF Submission Ingestion Package generated from Vireo submission #17991 on 2022-11-11 at 12:58:17","360◦ videos have revolutionized the way we perceive multimedia content. However, 2D videos still remain the standard, with many file formats, algorithms, and approaches structured for and compliant with 2D formats. 360◦ videos, in general, face difficulties when applied to these established 2D frameworks. For example, convolutional neural networks (CNNs) are trained on images taken from cameras that rely on a perspective projection model, and thus cannot be easily applied to 360◦ imagery, which relies on spherical formats. In this thesis, we look to enhance the viewing experience in two diverse contexts that rely on 360◦ experiences. We look to relax computational challenges from 360◦ formats in these diverse contexts by exploring ways in which we can bridge the gap between CNN applications tailored to the 2D space and 360◦ imagery. In the first context, we look at 360◦ video streaming scenarios. 360◦ videos are of higher resolutions than 2D videos, causing greater bandwidth consumption when streamed and straining the network capacity of cloud providers. To address this problem, we introduce L3BOU, a novel, three-tier distributed software framework that reduces cloud-edge bandwidth in the backhaul network and lowers average end-to-end latency for 360◦ video streaming applications. The L3BOU framework leverages edge-based, optimized upscaling techniques. L3BOU utilizes downscaled MPEG-DASH-encoded 360◦ video data, known as Ultra Low Resolution (ULR) data, that the L3BOU edge applies distributed super-resolution techniques on, providing a high quality video to the client. For the second context, we pivot towards the emergency response domain. Demonstrating firefighting operations in search and rescue missions through videos is a common approach to in-classroom firefighter training. Unfortunately, traditional 2D cameras have fundamental weaknesses – they can only capture a narrow field of view and miss a lot of information coming from the surroundings of the firefighter. Therefore, we propose a system combining the advantage of 360◦ videos and deep learning to automatically detect important objects in the panoramic scene, assisting firefighting instructors in classroom teaching scenarios. Specifically, we summarize the salient objects and events relevant to firefighting through an interview with an experienced firefighting instructor. Leveraging this knowledge, we investigate the detection of firefighting objects on 360◦ videos through a transfer learning approach. We report insightful results for object detectors trained on generic objects and 2D videos and discuss the next steps in designing a customized object detector."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/115757"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Ayush Sarkar"],"dc:subject":["360◦ video","video streaming","super-resolution","edge computing","bandwidth","latency","firefighting","object detection"],"dc:title":["Viewing enhancement of 360◦ videos in diverse contexts"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:55Z"}