{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/115495"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/115495","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Learning-based saliency-aware compression framework","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-11 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-11 without embargo terms","abstract_has_math":false,"creators":["Chen, Bo"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Nahrstedt, Klara","Abdelzaher, Tarek","Sundaram, Hari","Yan, Zhisheng"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-05","date_published":"2022-05","updated_at":"2026-07-22T22:24:54Z","subjects":["Video Compression","Machine Learning","Networking","Video Saliency"],"languages":["en","eng"],"rights":["Copyright 2022 Bo Chen"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/115495","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Nahrstedt, Klara","Abdelzaher, Tarek","Sundaram, Hari","Yan, Zhisheng"]},{"key":"dc:creator","label":"Author","values":["Chen, Bo"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-05","2022-04-19"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Video Compression","Machine Learning","Networking","Video Saliency"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Bo Chen"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/115495"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-11 without embargo terms","The student, Bo Chen, accepted the attached license on 2022-04-19 at 11:35.","The student, Bo Chen, submitted this Dissertation for approval on 2022-04-19 at 11:51.","This Dissertation was approved for publication on 2022-04-19 at 17:05.","DSpace SAF Submission Ingestion Package generated from Vireo submission #17798 on 2022-11-11 at 13:15:50","Networked vision systems are prevalent nowadays due to the dominance of video traffic over the Internet. Videos in the networked vision system are transmitted over the Internet to a vision application, which processes videos by deep neural networks (DNN), i.e., computation offloading, or presents videos to human viewers, i.e., video streaming. The video codec is an essential component in the networked vision system, which compresses videos to a small size with minimal impact on the video quality. Traditional video codecs like MPEG, AVC, and HEVC have been widely adopted in the networked vision system in the past few decades. Recently, learned video codecs built on DNNs are gaining more attention due to their superior coding efficiency than traditional ones. Nonetheless, DNNs in networked vision systems introduce rate and quality heterogeneity, which lead to some issues in the networked vision system, e.g., low processing rate and poor coding efficiency. This dissertation aims at addressing the heterogeneity in networked vision systems. The thesis statement is that the rate and quality heterogeneity in networked vision systems should be addressed by leveraging the spatiotemporal saliency with learning-based adaptation in video compression. The spatiotemporal saliency characterizes how important pixels in the video are, which by our observation varies across different networked vision systems. Specifically, certain regions of interest (ROI) or keyframes are more significant in a given networked vision system. The key intuition is to adapt how information in a video is encoded spatially and temporally based on spatiotemporal saliency, i.e., saliency-aware adaptation to improve processing rate or coding efficiency with minimal impact on other metrics. The challenge lies in properly designing and training the adaptation module in a given networked vision system. To prove the thesis, this dissertation provides a suite of saliency-aware adaptation modules in the video codec, i.e., temporal adaptation (Learned Frame Sampling), spatial adaptation (Context-aware Compression and Spatial-adaptive Filter), and spatiotemporal adaptation (Space-time-aware Entropy Module), addressing the aforementioned challenge. Our evaluation covers various video categories, diverse vision applications, and state-of-the-art compression algorithms. The result demonstrates our approaches effectively improve the processing rate or the coding efficiency in networked vision systems compared to existing solutions without harming other performance metrics."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Learning-based saliency-aware compression framework"]}]}],"canonical_facts":{"dc:contributor":["Nahrstedt, Klara","Abdelzaher, Tarek","Sundaram, Hari","Yan, Zhisheng"],"dc:creator":["Chen, Bo"],"dc:date":["2022-05","2022-04-19"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-11 without embargo terms","The student, Bo Chen, accepted the attached license on 2022-04-19 at 11:35.","The student, Bo Chen, submitted this Dissertation for approval on 2022-04-19 at 11:51.","This Dissertation was approved for publication on 2022-04-19 at 17:05.","DSpace SAF Submission Ingestion Package generated from Vireo submission #17798 on 2022-11-11 at 13:15:50","Networked vision systems are prevalent nowadays due to the dominance of video traffic over the Internet. Videos in the networked vision system are transmitted over the Internet to a vision application, which processes videos by deep neural networks (DNN), i.e., computation offloading, or presents videos to human viewers, i.e., video streaming. The video codec is an essential component in the networked vision system, which compresses videos to a small size with minimal impact on the video quality. Traditional video codecs like MPEG, AVC, and HEVC have been widely adopted in the networked vision system in the past few decades. Recently, learned video codecs built on DNNs are gaining more attention due to their superior coding efficiency than traditional ones. Nonetheless, DNNs in networked vision systems introduce rate and quality heterogeneity, which lead to some issues in the networked vision system, e.g., low processing rate and poor coding efficiency. This dissertation aims at addressing the heterogeneity in networked vision systems. The thesis statement is that the rate and quality heterogeneity in networked vision systems should be addressed by leveraging the spatiotemporal saliency with learning-based adaptation in video compression. The spatiotemporal saliency characterizes how important pixels in the video are, which by our observation varies across different networked vision systems. Specifically, certain regions of interest (ROI) or keyframes are more significant in a given networked vision system. The key intuition is to adapt how information in a video is encoded spatially and temporally based on spatiotemporal saliency, i.e., saliency-aware adaptation to improve processing rate or coding efficiency with minimal impact on other metrics. The challenge lies in properly designing and training the adaptation module in a given networked vision system. To prove the thesis, this dissertation provides a suite of saliency-aware adaptation modules in the video codec, i.e., temporal adaptation (Learned Frame Sampling), spatial adaptation (Context-aware Compression and Spatial-adaptive Filter), and spatiotemporal adaptation (Space-time-aware Entropy Module), addressing the aforementioned challenge. Our evaluation covers various video categories, diverse vision applications, and state-of-the-art compression algorithms. The result demonstrates our approaches effectively improve the processing rate or the coding efficiency in networked vision systems compared to existing solutions without harming other performance metrics."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/115495"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Bo Chen"],"dc:subject":["Video Compression","Machine Learning","Networking","Video Saliency"],"dc:title":["Learning-based saliency-aware compression framework"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:54Z"}