{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/129928"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/129928","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Design and implementation of learning-based storage systems: a holistic approach","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","abstract_has_math":false,"creators":["Sun, Jinghan"],"institution":"University of Illinois Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Huang, Jian","Snir, Marc","Gropp, William","Patel, Sanjay","Swift, Michael","Chang, Jichuan"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-07-13","date_published":"2025-07-13","updated_at":"2026-07-22T22:25:06Z","subjects":["Storage Systems","Machine Learning For Systems","Hardware Software Co-design","Solid-state Drive","Cloud Storage"],"languages":["en","eng"],"rights":["Copyright 2025 Jinghan Sun"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/129928","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Huang, Jian","Snir, Marc","Gropp, William","Patel, Sanjay","Swift, Michael","Chang, Jichuan"]},{"key":"dc:creator","label":"Author","values":["Sun, Jinghan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-07-13","2025-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Storage Systems","Machine Learning For Systems","Hardware Software Co-design","Solid-state Drive","Cloud Storage"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Jinghan Sun"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/129928"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","The student, Jinghan Sun, accepted the attached license on 2025-07-09 at 16:17.","The student, Jinghan Sun, submitted this Dissertation for approval on 2025-07-09 at 16:27.","This Dissertation was approved for publication on 2025-07-13 at 07:51.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22469 on 2025-10-20 at 20:15:08","Storage systems have evolved over decades into a complicated ecosystem that includes storage hardware, system software, storage infrastructure, and data applications. This growing complexity poses significant challenges for storage development and deployment. Traditional human-driven, heuristic-based approaches to building storage systems cannot rapidly meet the ever-increasing demands for storage performance and efficiency. As we embrace the advancement of machine learning (ML), it is the golden age today to invent new approaches to building storage systems. This dissertation focuses on the design and implementation of learning-based storage systems across the entire storage stack, which develops learning-based approaches to optimize storage performance, resource efficiency, and management. The storage performance of traditional hardware and software cannot keep up with the increasing demands of applications. For example, in solid-state drives (SSDs), the flash translation layer (FTL) manages performance-critical metadata structures using human-driven heuristics, but it fails to adapt to different workload patterns and results in severe performance loss. To address this performance challenge, this dissertation proposes the first learning-based flash translation layer, LeaFTL, that can dynamically capture data access patterns of storage workloads at runtime. It significantly reduces the memory footprint of the address mapping table by grouping a large set of mapping entries into a learned segment. The saved memory space further benefits data caching and improves the overall storage performance. Storage resource efficiency is also critical as it directly affects the operational costs of storage infrastructure. For instance, cloud platforms manage storage resources at scale and it is beneficial for them to achieve high storage utilization. However, our study reveals that storage resources in modern cloud platforms are severely underutilized. To address this resource efficiency challenge, this dissertation proposes a learning-based storage harvesting framework named BlockFlex, that can dynamically harvest idle storage capacity and bandwidth to improve cloud storage utilization. BlockFlex leverages a lightweight online learning approach to predict resource utilization and storage resource demands, based on which it enables accurate storage resource harvesting. Storage management is becoming complicated with the rapid development of the software and hardware over the past decades. This is especially true for cloud platforms, where the cloud storage resource is shared by multiple tenants with complex storage states and dynamic workload characteristics. Cloud platform enforces isolation mechanisms as it manages collocated tenants, but weak isolation incurs high performance interference and strong isolation causes low storage utilization. This dissertation explores reinforcement learning (RL) techniques to combat this fundamental tussle, leveraging its unique advantages of optimizing decisions in the complex and dynamic environment. It employs multi-agent reinforcement learning to dynamically manage resource scheduling across multiple tenants. Our experiments show that it can achieve both high storage utilization and performance isolation."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Design and implementation of learning-based storage systems: a holistic approach"]}]}],"canonical_facts":{"dc:contributor":["Huang, Jian","Snir, Marc","Gropp, William","Patel, Sanjay","Swift, Michael","Chang, Jichuan"],"dc:creator":["Sun, Jinghan"],"dc:date":["2025-07-13","2025-08"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","The student, Jinghan Sun, accepted the attached license on 2025-07-09 at 16:17.","The student, Jinghan Sun, submitted this Dissertation for approval on 2025-07-09 at 16:27.","This Dissertation was approved for publication on 2025-07-13 at 07:51.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22469 on 2025-10-20 at 20:15:08","Storage systems have evolved over decades into a complicated ecosystem that includes storage hardware, system software, storage infrastructure, and data applications. This growing complexity poses significant challenges for storage development and deployment. Traditional human-driven, heuristic-based approaches to building storage systems cannot rapidly meet the ever-increasing demands for storage performance and efficiency. As we embrace the advancement of machine learning (ML), it is the golden age today to invent new approaches to building storage systems. This dissertation focuses on the design and implementation of learning-based storage systems across the entire storage stack, which develops learning-based approaches to optimize storage performance, resource efficiency, and management. The storage performance of traditional hardware and software cannot keep up with the increasing demands of applications. For example, in solid-state drives (SSDs), the flash translation layer (FTL) manages performance-critical metadata structures using human-driven heuristics, but it fails to adapt to different workload patterns and results in severe performance loss. To address this performance challenge, this dissertation proposes the first learning-based flash translation layer, LeaFTL, that can dynamically capture data access patterns of storage workloads at runtime. It significantly reduces the memory footprint of the address mapping table by grouping a large set of mapping entries into a learned segment. The saved memory space further benefits data caching and improves the overall storage performance. Storage resource efficiency is also critical as it directly affects the operational costs of storage infrastructure. For instance, cloud platforms manage storage resources at scale and it is beneficial for them to achieve high storage utilization. However, our study reveals that storage resources in modern cloud platforms are severely underutilized. To address this resource efficiency challenge, this dissertation proposes a learning-based storage harvesting framework named BlockFlex, that can dynamically harvest idle storage capacity and bandwidth to improve cloud storage utilization. BlockFlex leverages a lightweight online learning approach to predict resource utilization and storage resource demands, based on which it enables accurate storage resource harvesting. Storage management is becoming complicated with the rapid development of the software and hardware over the past decades. This is especially true for cloud platforms, where the cloud storage resource is shared by multiple tenants with complex storage states and dynamic workload characteristics. Cloud platform enforces isolation mechanisms as it manages collocated tenants, but weak isolation incurs high performance interference and strong isolation causes low storage utilization. This dissertation explores reinforcement learning (RL) techniques to combat this fundamental tussle, leveraging its unique advantages of optimizing decisions in the complex and dynamic environment. It employs multi-agent reinforcement learning to dynamically manage resource scheduling across multiple tenants. Our experiments show that it can achieve both high storage utilization and performance isolation."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/129928"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Jinghan Sun"],"dc:subject":["Storage Systems","Machine Learning For Systems","Hardware Software Co-design","Solid-state Drive","Cloud Storage"],"dc:title":["Design and implementation of learning-based storage systems: a holistic approach"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:06Z"}