NEURO-SYMBOLIC AI APPROACHES FOR SENSOR-BASED HUMAN ACTIVITY RECOGNITION
type: CreativeWork
description: Sensor-based Human Activity Recognition (HAR) is an active research area, with relevant applications in healthcare and well-being. Deep Learning (DL) classifiers are currently the leading approach to tackle HAR, but their deployment is often limited by their inherent opacity and the scarcity of labeled training data. Fortunately, common sense and domain knowledge about activity execution can improve purely data-driven approaches. Indeed, in the general machine learning community, Neuro-Symbolic AI (NeSy) methods are emerging to combine DL models with more traditional symbolic AI techniques that rely on knowledge-based reasoning to improve models' interpretability while reducing their reliance on labeled data during training. This thesis explores innovative NeSy solutions proposed to enhance sensor-based HAR. The initial chapters focus on NeSy methods designed to mitigate the scarcity of labeled training data. Considering smart-home environments inhabited by multiple subjects, a main problem is data association, i.e., correctly associating sensor events (e.g., the opening of the fridge) with the subject(s) that actually generated them. Most works in the literature addressed this challenge with purely data-driven solutions, thus aggravating the labeled data scarcity problem. For this reason, we propose a NeSy method that relies on symbolic reasoning to tackle data association without the need for any labeled data. Moreover, we also address data scarcity for context-aware HAR based on mobile devices. While NeSy approaches have been already proposed in this research area, they rely on domain knowledge only after the training process of the DL classifier. This limits its ability to handle data uncertainty. Hence, we present two novel NeSy approaches that infuse domain knowledge into DL classifiers during their learning process. Experimental results show how such methods reduce the amount of labeled data required during training while being more robust to noisy data compa…
abstract: Sensor-based Human Activity Recognition (HAR) is an active research area, with relevant applications in healthcare and well-being. Deep Learning (DL) classifiers are currently the leading approach to tackle HAR, but their deployment is often limited by their inherent opacity and the scarcity of labeled training data. Fortunately, common sense and domain knowledge about activity execution can improve purely data-driven approaches. Indeed, in the general machine learning community, Neuro-Symbolic AI (NeSy) methods are emerging to combine DL models with more traditional symbolic AI techniques that rely on knowledge-based reasoning to improve models' interpretability while reducing their reliance on labeled data during training. This thesis explores innovative NeSy solutions proposed to enhance sensor-based HAR. The initial chapters focus on NeSy methods designed to mitigate the scarcity of labeled training data. Considering smart-home environments inhabited by multiple subjects, a main problem is data association, i.e., correctly associating sensor events (e.g., the opening of the fridge) with the subject(s) that actually generated them. Most works in the literature addressed this challenge with purely data-driven solutions, thus aggravating the labeled data scarcity problem. For this reason, we propose a NeSy method that relies on symbolic reasoning to tackle data association without the need for any labeled data. Moreover, we also address data scarcity for context-aware HAR based on mobile devices. While NeSy approaches have been already proposed in this research area, they rely on domain knowledge only after the training process of the DL classifier. This limits its ability to handle data uncertainty. Hence, we present two novel NeSy approaches that infuse domain knowledge into DL classifiers during their learning process. Experimental results show how such methods reduce the amount of labeled data required during training while being more robust to noisy data compa…
author: ARROTTA, LUCA
language: eng
keywords: Pervasive Computing, Human Activity Recognition, Neuro-Symbolic AI, Settore INF/01 - Informatica
date published: 2024-01-26
date modified: 2026-07-27T20:18:43Z
provider: Università degli Studi di Milano
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: Università degli Studi di Milano

PropertyValue
property ID: Handle
value: https://hdl.handle.net/2434/1022155

PropertyValue
property ID: DOI
value: 10.13130/arrotta-luca_phd2024-01-26