Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 48 for “"Captioning"”.
-
Automatic Image Captioning with Style
This thesis connects two core topics in machine learning, vision and language. The problem of choice is image caption generation: automatically constructing natural language descriptions of image content. Previous research into image caption generation has focused on generating purely descriptive …
-
Automatic Image Captioning with Style
This thesis connects two core topics in machine learning, vision and language. The problem of choice is image caption generation: automatically constructing natural language descriptions of image content. Previous research into image caption generation has focused on generating purely descriptive …
-
Image captioning using compositional sentiments
… emotionally salient aspects of an image, many captioning models have difficulties in detecting and generating these non-factual aspects. This is caused by lack of sentiment information in the caption dataset. We solve this issue by preprocessing the text captions in an image captioning dataset …
-
Towards abstractive captioning of infographics
Machine understanding of text-based narratives have predominantly focused on documents with rigid hierarchical structures and sequentially ordered inputs. These inputs include documents such as news stories, encyclopedia entries, books, and many others. However, little research has focused on …
-
IMAGE CAPTIONING FOR REMOTE SENSING IMAGE ANALYSIS
Image Captioning (IC) aims to generate a coherent and comprehensive textual description that summarizes the complex content of an image. It is a combination of computer vision and natural language processing techniques to encode the visual features of an image and translate them into a sentence. In …
-
Advanced Methods for Remote Sensing Image Captioning
… representations tied to fixed concepts. Image captioning (IC) involves generating natural language descriptions for images, enabling machines to communicate their perception through language. This approach provides a flexible framework to convey diverse semantics. Despite significant …
-
Understanding what a captioning network doesn't know
While recent years have seen significant advances in the capabilities of image recognition and classification neural networks, we still know little about the relationship between the activation of hidden layers and human-understandable concepts. Recent work in network interpretability has provided …
-
VisText: A Benchmark for Semantically Rich Chart Captioning
… state-of-the-art language models on our chart captioning task and apply prefix-tuning to produce captions that vary the semantic content they convey. Our models generate coherent, semantically rich captions and perform on par with state-of-the-art chart captioning models across machine …
-
Connecting vision and language via image retrieval and captioning
… vision and language, e.g. image/video captioning, multi-modal image retrieval, visual question answering. In this thesis, we consider several problems in cross-modal learning from vision and language. First, the problem of composed query image retrieval is studied. In this problem, the …
-
Exploring the Internal Statistics: Single Image Super-Resolution, Completion and Captioning
… which belong to low-level vision research, image captioning is a high-level vision task related to the semantic understanding of an input image. It is a natural task for human beings. However, image captioning remains challenging from a computer vision point of view especially due to the fact that …
-
Exposing and correcting the gender bias in image captioning datasets and models
The task of image captioning implicitly involves gender identification. However, due to the gender bias in data, gender identification by an image captioning model suffers. Also, due to the word-by-word prediction, the gender-activity bias in the data tends to influence the other words in the …
-
Text-Free Audio Captions of Short Videos from Latent Space Representation
… previous work exploring image to speech captioning. We expand upon the work to implement video to speech captioning. Specifically, we implement a text-free image to speech captioning pipeline that integrates four distinct machine learning models. We alter the models to process video data …
-
The Effects Of Closed-Captioned Television On The Oral Reading Fluency Of Low Socioeconomic 2nd Grade Students
Research into the use of closed-captioning has provided exciting evidence into the possibilities of its usefulness as a literacy tool. Although previous studies have shown the efficacy of closed-captioning as a tool that can assist the deaf and hard-of-hearing, those learning a second language, and …
-
Learning multiple solutions to computer vision problems
… 12, 18] and vision language tasks, e.g. image captioning [19, 20, 21], visual question answering [22, 23, 24, 25, 26] etc. Convolutional neural networks [27, 28] and/or Recurrent Neural Networks [29] trained to regress to a single value or classify to a single class label are the workhorse of …
-
Human activity analysis using radio signals
… process of human action recognition and event captioning from visual data has been the topic of much research in the computer vision community. But what if it is too dark, or if the person is occluded or behind a wall? This thesis develops a model that can detect human actions through walls and …
-
THE ACQUISITION OF PHRASAL VERBS THROUGH ENHANCED AUDIOVISUAL CAPTIONS. IMPLICATIONS FOR THE DEVELOPMENT OF A SUBTITLING TOOL FOR EFL LEARNERS
… TIE (such as colouring, highlighting, or keyword captioning) lead to differential outcomes in noticing and retention. This gap in the literature is particularly evident concerning more complex lexico-grammatical items, such as English phrasal verbs (PVs). Although TIE techniques have been …
-
Vision and Language: Information Integration and Transformation
… question answering, visual grounding, and image captioning. In particular, we explore and develop techniques combining image and text information to improve transformation between modalities. First, we exploit the multilingual image captioning and the multimodal machine translation tasks, using …
-
Personalcasting : interactive local augmentation of television programming
… system is developed which uses closed-captioning information as a data input and allows variation in the presentation of television newscasts, with results applicable to the locally-intelligent recording and personalized presentation of other sorts of programming as well. The research …
-
Multimodal machine translation
… also propose a multitask system which uses image captioning task to aid the translation task. Our models are tested on multiple datasets using the automatic evaluation metrics like METEOR and BLEU. The experiments show that the proposed models outperform the text-only baseline model.
-
Understanding language through visual imagination
… to solve natural language inference, video captioning and video completion without task-specific training. The only training required is for acquiring a lexicon from captioned videos similar to the way children learn language through exposure to perceptual cues. The model generates videos by …
Page 1 of 3