Exploiting relations among output variables for prediction and forecasting

In this work, we develop new approaches to model the relationships between problem variables and demonstrate that exploiting these relationships leads to improved performance for prediction and forecasting tasks. For structured output prediction, we describe a model which merges classical graphical model-based structured prediction methods with deep energy network-based approaches. We show that combining the strengths of these two approaches allows for improved performance over using them individually. Next, we introduce an approach for multi-entity trajectory prediction tasks which explicitly predicts the relationships between the entities at every point in time and uses these to select the model parameters used to forecast their future states. We show that predicting dynamic relations can lead to improved trajectory prediction performance over using a static relation graph. After this, we introduce the panoptic segmentation forecasting task and develop an initial approach to model this task. This approach functions by decomposing the scene into moving foreground components and static background components, modeling the motion of each separately. Finally, we show that introducing additional interaction modeling to the previous framework, both between all foreground instances and between foreground and background objects, leads to improved task performance and more consistent panoptic segmentation forecasts.

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2022

Author dc:creator

• Graber, Colin G

Contributors dc:contributor

• Schwing, Alexander
• Forsyth, David
• Hoiem, Derek
• Firman, Michael

• machine learning
• computer vision
• structured output prediction
• trajectory prediction
• panoptic segmentation
• panoptic segmentation forecasting

Statement dc:rights

• Copyright 2022 Colin Graber

Language dc:language

en, eng

Handle dc:identifier

https://hdl.handle.net/2142/115463

OAI record oai:identifier

https://www.ideals.illinois.edu/oai-pmh?verb=GetRecord&metadataPrefix=etdms&identifier=oai%3Awww.ideals.illinois.edu%3A2142%2F115463