360° and 2D video analytics in network and energy constrained environments

Real-time video analytics enables rapid, automated content understanding, significantly reducing the time required to search through captured footage. However, many real-world scenarios that could benefit from real-time analytics face constraints that remain underexplored. This thesis focuses on one such use case: firefighter training. Firefighters rely on video for decision-making, post-mission feedback, and developing new training scenarios. However, deploying cameras in outdoor training environments presents two major challenges: limited network connectivity due to the distance from Wi-Fi infrastructure and restricted energy availability as cameras operate on battery power. To investigate network limitations, we conducted field tests at the Illinois Fire Service Institute (IFSI) to analyze connectivity from various locations on the grounds. Additionally, we developed a streaming framework supporting multiple video codecs (MJPEG, WebP, Tiled MJPEG, and H.264) and systematically evaluated their impact on bandwidth usage and 360° video streaming performance under real-world conditions at IFSI. To address the problem of energy-efficient video processing we developed a system, EcoLens, that dynamically optimizes processing configurations to minimize energy consumption of the camera while preserving essential video features for deep learning inference. We first conducted an extensive offline evaluation of various configurations comprising of device CPU frequency, frame filtering features, difference thresholds, and video bitrates, to establish apriori knowledge of their impact on energy consumption and inference accuracy. Leveraging this insight, we introduced an online system that employs multi-objective Bayesian optimization to intelligently explore and adapt configurations in real time. Our approach continuously refines processing settings to meet target inference accuracy with minimal edge device energy expenditure. Experimental results demonstrated the system’s effectiveness in reducing video processing energy use while maintaining high analytical performance, offering a practical solution for smart devices and edge computing applications.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois Urbana-Champaign

Year dc:date

2025

Author dc:creator

• Civjan, Benjamin

Contributors dc:contributor

• Nahrstedt, Klara

• energy
• edge computing
• object detection
• 360-degree video
• video analytics
• firefighting

Statement dc:rights

• Copyright 2025 Benjamin Civjan. All rights reserved.

Language dc:language

en, eng

Handle dc:identifier

https://hdl.handle.net/2142/129199

OAI record oai:identifier

https://www.ideals.illinois.edu/oai-pmh?verb=GetRecord&metadataPrefix=etdms&identifier=oai%3Awww.ideals.illinois.edu%3A2142%2F129199