{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/99503"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/99503","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Henge: An intent-driven scheduler for multi-tenant stream processing","abstract":"This thesis presents Henge, a system that supports intent-based multi-tenancy in modern stream processing applications. Henge supports multi-tenancy as a first-class citizen: everyone inside an organization can now submit their stream processing jobs to a single, shared, consolidated cluster. Additionally, Henge allows each tenant (job) to specify its own intents (i.e., requirements) as a Service Level Objective (SLO) that captures latency and/or throughput. In a multi-tenant cluster, the Henge scheduler adapts continually to meet jobs’ SLOs in spite of limited cluster resources, and under dynamic input workloads. SLOs are soft and are based on utility functions. Henge continually tracks SLO satisfaction, and when jobs miss their SLOs, it wisely navigates the state space to perform resource allocations in real time, maximizing total system utility achieved by all jobs in the system. Henge is integrated in Apache Storm and the thesis presents experimental results, using both production topologies and real datasets.","abstract_html":"This thesis presents Henge, a system that supports intent-based multi-tenancy in modern stream processing applications. Henge supports multi-tenancy as a first-class citizen: everyone inside an organization can now submit their stream processing jobs to a single, shared, consolidated cluster. Additionally, Henge allows each tenant (job) to specify its own intents (i.e., requirements) as a Service Level Objective (SLO) that captures latency and/or throughput. In a multi-tenant cluster, the Henge scheduler adapts continually to meet jobs’ SLOs in spite of limited cluster resources, and under dynamic input workloads. SLOs are soft and are based on utility functions. Henge continually tracks SLO satisfaction, and when jobs miss their SLOs, it wisely navigates the state space to perform resource allocations in real time, maximizing total system utility achieved by all jobs in the system. Henge is integrated in Apache Storm and the thesis presents experimental results, using both production topologies and real datasets.","abstract_has_math":false,"creators":["Kalim, Faria"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Gupta, Indranil"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018-03-13T17:35:43Z","date_published":"2018-03-13T17:35:43Z","updated_at":"2026-07-22T22:24:37Z","subjects":["Stream processing","Service level objectives","Multi-tenancy","Distributed systems"],"languages":["en"],"rights":["Copyright 2017 Faria Kalim"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/99503","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Gupta, Indranil"]},{"key":"dc:creator","label":"Author","values":["Kalim, Faria"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2018-03-13T17:35:43Z","2020-03-14T09:15:12Z","2017-12-04","2017-12"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Stream processing","Service level objectives","Multi-tenancy","Distributed systems"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2017 Faria Kalim"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/99503"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This thesis presents Henge, a system that supports intent-based multi-tenancy in modern stream processing applications. Henge supports multi-tenancy as a first-class citizen: everyone inside an organization can now submit their stream processing jobs to a single, shared, consolidated cluster. Additionally, Henge allows each tenant (job) to specify its own intents (i.e., requirements) as a Service Level Objective (SLO) that captures latency and/or throughput. In a multi-tenant cluster, the Henge scheduler adapts continually to meet jobs’ SLOs in spite of limited cluster resources, and under dynamic input workloads. SLOs are soft and are based on utility functions. Henge continually tracks SLO satisfaction, and when jobs miss their SLOs, it wisely navigates the state space to perform resource allocations in real time, maximizing total system utility achieved by all jobs in the system. Henge is integrated in Apache Storm and the thesis presents experimental results, using both production topologies and real datasets.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2019-12-01","The student, Faria Kalim, accepted the attached license on 2017-12-04 at 13:41.","The student, Faria Kalim, submitted this Thesis for approval on 2017-12-04 at 13:51.","This Thesis was approved for publication on 2017-12-04 at 16:54.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11818 on 2018-03-13 at 10:37:19","Made available in DSpace on 2018-03-13T17:35:43Z (GMT). No. of bitstreams: 2 KALIM-THESIS-2017.pdf: 3149824 bytes, checksum: 1a1d9956c624f4aa3d379806d5627319 (MD5) LICENSE.txt: 4208 bytes, checksum: 12a2f1944760a6e0d6e4e380714f485b (MD5) Previous issue date: 2017-12-04","Embargo set by: Seth Robbins for item 105472 Lift date: 2020-03-13T17:36:05Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 105472 on 2020-03-14T09:15:12Z."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Henge: An intent-driven scheduler for multi-tenant stream processing"]}]}],"canonical_facts":{"dc:contributor":["Gupta, Indranil"],"dc:creator":["Kalim, Faria"],"dc:date":["2018-03-13T17:35:43Z","2020-03-14T09:15:12Z","2017-12-04","2017-12"],"dc:description":["This thesis presents Henge, a system that supports intent-based multi-tenancy in modern stream processing applications. Henge supports multi-tenancy as a first-class citizen: everyone inside an organization can now submit their stream processing jobs to a single, shared, consolidated cluster. Additionally, Henge allows each tenant (job) to specify its own intents (i.e., requirements) as a Service Level Objective (SLO) that captures latency and/or throughput. In a multi-tenant cluster, the Henge scheduler adapts continually to meet jobs’ SLOs in spite of limited cluster resources, and under dynamic input workloads. SLOs are soft and are based on utility functions. Henge continually tracks SLO satisfaction, and when jobs miss their SLOs, it wisely navigates the state space to perform resource allocations in real time, maximizing total system utility achieved by all jobs in the system. Henge is integrated in Apache Storm and the thesis presents experimental results, using both production topologies and real datasets.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2019-12-01","The student, Faria Kalim, accepted the attached license on 2017-12-04 at 13:41.","The student, Faria Kalim, submitted this Thesis for approval on 2017-12-04 at 13:51.","This Thesis was approved for publication on 2017-12-04 at 16:54.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11818 on 2018-03-13 at 10:37:19","Made available in DSpace on 2018-03-13T17:35:43Z (GMT). No. of bitstreams: 2 KALIM-THESIS-2017.pdf: 3149824 bytes, checksum: 1a1d9956c624f4aa3d379806d5627319 (MD5) LICENSE.txt: 4208 bytes, checksum: 12a2f1944760a6e0d6e4e380714f485b (MD5) Previous issue date: 2017-12-04","Embargo set by: Seth Robbins for item 105472 Lift date: 2020-03-13T17:36:05Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 105472 on 2020-03-14T09:15:12Z."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/99503"],"dc:language":["en"],"dc:rights":["Copyright 2017 Faria Kalim"],"dc:subject":["Stream processing","Service level objectives","Multi-tenancy","Distributed systems"],"dc:title":["Henge: An intent-driven scheduler for multi-tenant stream processing"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:37Z"}