Learning viewer-centered projections for 3D shape completion

"The goal of this study is to determine the effectiveness of different 3D shape representations in learning to generate volumetric shapes using deep neural networks. We propose to automatically reconstruct a 3D model from a single-view image of an object by synthesizing multiple depth images and inferring the volume through multi-view 3D reconstruction. The final output is a 3D mesh inferred without seeing voxels in the training process. This is similar to the intuition that humans remember (and inherently reproduce) 3D shapes without ever ""seeing through"" the underlying volume – we think of objects as seen from certain viewpoints and 3D structure is a derived concept. Most previous studies have focused on directly learning the voxel representations, deforming exemplars, or utilizing user interaction. In this paper, we want to learn category-independent object shape representations by simultaneously predicting multiple incomplete surfaces in relation to the viewer with the complete 3D structure in mind. Instead of predicting voxels which typically need to be in low resolution, we hypothesize that learning a representation that can consistently produce partial surfaces in a multi-task learning model enables inter-category 3D shape transfer. We perform shape completion in novel categories and evaluate quantitatively using voxel I/U and surface distance metrics. We also report that the learned representation improves 3D shape classification."

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2017

Author dc:creator

• Shin, Daeyun

Contributors dc:contributor

• Hoiem, Derek

• 3D shape learning
• Deep encoder-decoder networks
• Vision for graphics
• Multi-view reconstruction

Statement dc:rights

• Copyright 2017 Daeyun Shin

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/98435

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/98435