Washington University in St. Louis
NeVR: Learning Continuous Neural Video Representation with Local Feature Codes for Video Interpolation
Abstract
dc:description.abstract<p>Video frame interpolation aims to synthesis a non-exists intermediate frame guided by two successive frames. Recently, some work shows excellent results in learning continuous representation of temporally-varying 3D objects with neural field (NF), which could be used for interpolating the original video. However, these methods require several videos from different viewing angles, the information of camera poses, learning for each specific scene, and achieving sub-optimal results for video frame interpolation. To this end, we propose a new learning neural field representation-based model, Neural Video Representation (NeVR) to learn a continuous representation of videos for high-quality video interpolation. Unlike the traditional video interpolation algorithm, which directly synthesis the whole intermediate frame, our model aims to map the temporal-spatial coordinates of the queried pixels to the corresponding pixel value of the interpolated frame. Additionally, NeVR takes a latent feature code associated with queried pixels as input to enhance the image quality. That feature code contains the information of local implicit features and bilateral motion of the input frames and is obtained by a jointly trained encoder. Our experiments show that the proposed algorithm outperforms the state-of-the-art methods in video frame interpolation on several benchmark datasets.</p>
Degree
thesis:*- Name thesis:degree_name
- Master of Science (MS)
- Level thesis:degree_level
- Dissertation
- Discipline thesis:degree_discipline
- Electrical & Systems Engineering
- Year dc:date.available
- 2021
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Shangguan, Wentao
- Contributors dc:contributor
-
- Ulugbek Kamilov
- Joseph A. O’Sullivan, Umberto Villa
Subjects
dc:subject × 5Rights
dc:rights- Statement dc:rights
-
- I have not registered my thesis with the U.S. Copyright Office, and do not intend to.
- Language dc:language
- English (en)
Identifiers
dc:identifier.*- OAI identifier oai:identifier
- oai:openscholarship.wustl.edu:eng_etds-1743