Attention mechanism in deep neural networks for computer vision tasks

<p>“Attention mechanism, which is one of the most important algorithms in the deep Learning community, was initially designed in the natural language processing for enhancing the feature representation of key sentence fragments over the context. In recent years, the attention mechanism has been widely adopted in solving computer vision tasks by guiding deep neural networks (DNNs) to focus on specific image features for better understanding the semantic information of the image. However, the attention mechanism is not only capable of helping DNNs understand semantics, but also useful for the feature fusion, visual cue discovering, and temporal information selection, which are seldom researched. In this study, we take the classic attention mechanism a step further by proposing the <em>Semantic Attention Guidance Unit</em> (SAGU) for multi-level feature fusion to tackle the challenging Biomedical Image Segmentation task. Furthermore, we propose a novel framework that consists of (1) <em>Semantic Attention Unit</em> (SAU), which is an advanced version of SAGU for adaptively bringing high-level semantics to mid-level features, (2) <em>Two-level Spatial Attention Module</em> (TSPAM) for discovering multiple visual cues within the image, and (3) <em>Temporal Attention Module</em> (TAM) for temporal information selection to solve the Videobased Person Re-identification task. To validate our newly proposed attention mechanisms, extensive experiments are conducted on challenging datasets. Our methods obtain competitive performance and outperform state-of-the-art methods. Selective publications are also presented in the Appendix”--Abstract, page iii.</p>

Name thesis:degree_name

Ph. D. in Computer Science

Grantor

Missouri University of Science and Technology

Author dc:creator

• Li, Haohan

• Active Learning
• Attention Mechanism
• Biomedical Image Analysis
• Computer Vision
• Deep Learning
• Person Re-Identification
• Computer Sciences

Repository record dc:identifier

https://scholarsmine.mst.edu/doctoral_dissertations/3132

OAI identifier oai:identifier

oai:scholarsmine.mst.edu:doctoral_dissertations-4137