Individual recognition from low quality and occluded images and videos using GAN
type: CreativeWork
description: Face recognition in the wild is one of the most interesting problems in the present world. Many algorithms with high performance have already been proposed and applied in real-world applications. However, the problem of recognising degraded faces from low-quality images and videos mostly remains unsolved. In recent times, we have seen a breakthrough in the perceptual quality of image enhancement with the recovery of the fine texture details and sharpness of degraded images. Several state-of-the-art algorithms, like ARCNN, IRCNN, SRGAN, etc., provide excellent results in the field of image enhancement. However, regarding face recognition, these algorithms fail miserably. Thus, we designed an algorithm which is specific to the enhancement of faces for better recognition performance. Thus, we present a versatile GAN capable of recovering facial features from degraded videos and images. The proposed method enhances the degraded faces by restoring their lost facial features rather than its perceptual quality, which ultimately leads to better performance of any existing face recognition algorithm. The limitation using a single image is that there is an upper bound to which we can enhance the images. This motivated us to develop the idea of synthesising the frontal face pose from multiple occluded images of the same identity, taken at different times and from different angles. This helps to further push the upper bound. Our network crowdsources useful information from all images and rejects information that is not useful for recognition. We build our generator on top of TPGAN and use the concept of a U-net discriminator which evaluates the output both at a global and local level, thus boosting the image to be consistent at a global and local level.
abstract: Face recognition in the wild is one of the most interesting problems in the present world. Many algorithms with high performance have already been proposed and applied in real-world applications. However, the problem of recognising degraded faces from low-quality images and videos mostly remains unsolved. In recent times, we have seen a breakthrough in the perceptual quality of image enhancement with the recovery of the fine texture details and sharpness of degraded images. Several state-of-the-art algorithms, like ARCNN, IRCNN, SRGAN, etc., provide excellent results in the field of image enhancement. However, regarding face recognition, these algorithms fail miserably. Thus, we designed an algorithm which is specific to the enhancement of faces for better recognition performance. Thus, we present a versatile GAN capable of recovering facial features from degraded videos and images. The proposed method enhances the degraded faces by restoring their lost facial features rather than its perceptual quality, which ultimately leads to better performance of any existing face recognition algorithm. The limitation using a single image is that there is an upper bound to which we can enhance the images. This motivated us to develop the idea of synthesising the frontal face pose from multiple occluded images of the same identity, taken at different times and from different angles. This helps to further push the upper bound. Our network crowdsources useful information from all images and rejects information that is not useful for recognition. We build our generator on top of TPGAN and use the concept of a U-net discriminator which evaluates the output both at a global and local level, thus boosting the image to be consistent at a global and local level.
author: Ghosh, Soumya Shubhra
language: eng
keywords: Face recognition, deep learning, neural network, generative adversarial networks, GAN, artifact removal, noise removal, super-resolution
date published: 2021-12
date modified: 2026-07-24T03:56:04Z
provider: Queen's University Belfast
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: Queen's University Belfast