University of Illinois at Urbana-Champaign
Accelerating queries for structured and unstructured data
Abstract
dc:descriptionData analytics is important for making data-driven decisions. As data volumes expand, the efficiency and cost of executing queries become critical concerns for analysts. Traditionally, analytics systems have prioritized structured data. Approximate Query Processing (AQP) systems, which provide faster aggregation queries by delivering approximate results, have been developed to enhance efficiency. However, they are limited used in real-application due to compatibility issues with popular databases and restrictions on the types of queries they can handle. To overcome these limitations, we have designed an innovative AQP system that functions as middleware. This system uses online sampling techniques to accelerate aggregation queries and can meet user-specified error targets. With advancements in machine learning (ML), analysts are increasingly interested in analyzing unstructured data (videos, images, text, and audio) to extract semantic information. Current analytics systems typically integrate ML models through user-defined functions (UDFs). These UDFs can be difficult to optimize and require application users to write complex, nested table expressions. To address these challenges, we introduce a new data model, AIDM, enabling users to query ML model outputs as standard SQL tables, through virtual columns and virtual tables. We implement AIDM, as well as novel optimizations for accelerating both approximate and exact queries in AIDB. Our evaluations show that the AQP system can provide speedups of up to 87x and AIDB can reduce the number of ML model invocations by up to 98%.
Degree
thesis:*- Name thesis:degree_name
- M.S.
- Level thesis:degree_level
- Thesis
- Discipline thesis:degree_discipline
- Electrical & Computer Engr
- Grantor
- University of Illinois at Urbana-Champaign
- Year dc:date
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Jin, Tengjun
- Contributors dc:contributor
-
- Kang, Daniel
Subjects
dc:subject × 3Rights
dc:rights- Statement dc:rights
-
- Copyright 2024 Tengjun Jin
- Language dc:language
- en, eng
Identifiers
dc:identifier.*- Handle dc:identifier
- https://hdl.handle.net/2142/124567