Inferring object states and articulation modes from egocentric videos
type: CreativeWork
description: We develop algorithms for understanding objects from the point of view of interacting with them. There are two key aspects to obtaining such an understanding. First, objects can occur in different states and we need features that are sensitive to such states. Second, different objects can be articulated in different ways and we need to understand how to correctly infer their modes of articulation. We propose self and weakly supervised techniques to obtain such an understanding of objects purely through observation of how humans interact with the world around them through their hands. Our experiments on the challenging EPIC- KITCHENS dataset show the merits of using human hands as a probe for understanding objects.
abstract: We develop algorithms for understanding objects from the point of view of interacting with them. There are two key aspects to obtaining such an understanding. First, objects can occur in different states and we need features that are sensitive to such states. Second, different objects can be articulated in different ways and we need to understand how to correctly infer their modes of articulation. We propose self and weakly supervised techniques to obtain such an understanding of objects purely through observation of how humans interact with the world around them through their hands. Our experiments on the challenging EPIC- KITCHENS dataset show the merits of using human hands as a probe for understanding objects.
author: Goyal, Rishabh
language: en
keywords: Computer Vision, Machine Learning, Feature Learning, Object Understanding
date published: 2021-09-17T02:34:49Z
date modified: 2026-07-22T22:24:52Z
provider: University of Illinois - Urbana-Champaign
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: University of Illinois at Urbana-Champaign

PropertyValue
property ID: Handle
value: http://hdl.handle.net/2142/110748