Towards efficient tuning of computer systems: auto-structured Bayesian optimization from system metrics
type: CreativeWork
description: Optimizing complex computer systems, like databases, requires careful tuning of numerous user-configurable parameters. This process is often a laborious trial-and-error effort, motivating the development of automated tuning systems (auto-tuners). However, conventional black-box auto-tuners, which disregard the wealth of expert knowledge embedded within system designs, often require a prohibitively large number of full system evaluations. While Structured Bayesian Optimization (SBO), as proposed in (Dalibard et al., 2017), offers a promising alternative by incorporating probabilistic performance models, it suffers from two limitations. The first is the difficulty of designing these models, which requires expertise in both the system and probabilistic machine learning. The second is scalability issues when dealing with complex system structures. This dissertation introduces a novel SBO framework that leverages system health metrics and eliminates the need for hand-designed probabilistic models. Our approach allows experts to define high-level relationships between configurations, health metrics, and the tuning objective, while simultaneously learning causal structures from system health metrics to augment expert intuition. Crucially, this requires a scalable framework capable of handling complex probabilistic structures. We first present Bayesian Optimization with Bayesian Networks (BoBn), a library that facilitates expressing high-level system knowledge through a graph-based API. BoBn translates this structural information into a probabilistic model that guides the optimizer, supporting a wide range of user-defined or automatically generated models within its graph. Furthermore, BoBn adds multi-objective optimization capabilities to SBO. Its key contribution is its ability to leverage GPUs and accelerators with intelligent memory management, significantly extending the scalability of SBO beyond existing industry tools. Next, we introduce BoGraph, an extension that au…
abstract: Optimizing complex computer systems, like databases, requires careful tuning of numerous user-configurable parameters. This process is often a laborious trial-and-error effort, motivating the development of automated tuning systems (auto-tuners). However, conventional black-box auto-tuners, which disregard the wealth of expert knowledge embedded within system designs, often require a prohibitively large number of full system evaluations. While Structured Bayesian Optimization (SBO), as proposed in (Dalibard et al., 2017), offers a promising alternative by incorporating probabilistic performance models, it suffers from two limitations. The first is the difficulty of designing these models, which requires expertise in both the system and probabilistic machine learning. The second is scalability issues when dealing with complex system structures. This dissertation introduces a novel SBO framework that leverages system health metrics and eliminates the need for hand-designed probabilistic models. Our approach allows experts to define high-level relationships between configurations, health metrics, and the tuning objective, while simultaneously learning causal structures from system health metrics to augment expert intuition. Crucially, this requires a scalable framework capable of handling complex probabilistic structures. We first present Bayesian Optimization with Bayesian Networks (BoBn), a library that facilitates expressing high-level system knowledge through a graph-based API. BoBn translates this structural information into a probabilistic model that guides the optimizer, supporting a wide range of user-defined or automatically generated models within its graph. Furthermore, BoBn adds multi-objective optimization capabilities to SBO. Its key contribution is its ability to leverage GPUs and accelerators with intelligent memory management, significantly extending the scalability of SBO beyond existing industry tools. Next, we introduce BoGraph, an extension that au…
author: Alabed, Sami
language: eng
keywords: Structured Bayesian Optimization, Computer system optimization
license: https://www.repository.cam.ac.uk/bitstreams/8c1e9b78-5184-4803-94de-a89a1739cf51/download
license: http://purl.org/NET/rdflicense/allrightsreserved
date published: 2025-02-07
date modified: 2026-07-22T22:24:20Z
provider: Cambridge University
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: University of Cambridge

PropertyValue
property ID: DOI
value: 10.17863/CAM.121433