Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 18 of 18 for “"lip-reading"”.
-
Confusion modelling for lip-reading
Lip-reading is mostly used as a means of communication by people with hearing di�fficulties. Recent work has explored the automation of this process, with the aim of building a speech recognition system entirely driven by lip movements. However, this work has so far produced poor results because of …
-
Decoding visemes: improving machine lip-reading
Abstract This thesis is about improving machine lip-reading, that is, the classi�cation of speech from only visual cues of a speaker. Machine lip-reading is a niche research problem in both areas of speech processing and computer vision. Current challenges for machine lip-reading fall into two …
-
Infrastructure development for integration of lip reading into the SUMMIT Speech Recognizer
… an audio-only speech recognizer with visual lip-reading information, in order to improve the performance and robustness of the recognizer. The speech recognizer's variable length audio segments are resolved with the fixed length video frames using segment constrained Hidden Markov Modeling. A …
-
Relationships between selected subtests of the Leiter International Performance Scale and Illinois Test of Psycholinguistic Ability and Taaffe-Lowell's "A Film Test of Lip Reading".
… between some visual and mental tasks and lipreading proficiency. The fifty-seven female subjects' performance on performance tests were compared to the same subjects' grouping and scores achieved by administration of a standard lipreading test. The question of whether these subjects as …
-
Multi-signal processing for voice recognition in noisy environments
… the lower the recognition capability. Automatic lip reading through vision systems have been utilized to improve the recognition capability in noisy environments. However, this approach is costly and time-consuming. The objective of this thesis was to investigate the utilization of an Infrared …
-
Relation of short-term working memory and speech perception: a cross-sectional study
… any order. Additional measures included tests of lip-reading proficiency, receptive vocabulary knowledge, inhibition, subjective workload ratings and working memory. It was hypothesized that age would influence recall errors, with young adults having fewer errors compared to children and older …
-
Dubbing as an Audiovisual Translation Mode: English and Lithuanian Phonemic Inventories in the Context of Visual Phonetics /
… communication because of inborn human ability of lip reading, audiovisual synthesis has been transformed into the production of audiovisual market due to such factors as globalization and technological development, which discloses that the ability of lip reading is interrelated with the phenomenon …
-
Dubliavimas kaip audiovizualinio vertimo moda: anglų ir lietuvių kalbų garsynai vizualinės fonetikos kontekste /
… communication because of inborn human ability of lip reading, audiovisual synthesis has been transformed into the production of audiovisual market due to such factors as globalization and technological development, which discloses that the ability of lip reading is interrelated with the phenomenon …
-
Lipreading with convolutional and recurrent neural network models
Lip reading is the process of speech recognition from solely visual information. The goal of this thesis is to perform a silence vs. speech classification, and to recognize the triphone spoken by a talking head, given only the video using neural network classification models. Two neural network …
-
Shape Dynamical Models for Activity Recognition and Coded Aperture Imaging for Light-Field Capture
… insects and animals, facial expression changes, lip reading, genetic expression profiles are some examples of patterns that are dynamic. Models and algorithms to study these patterns must take into account the dynamics of these patterns while exploiting the classical pattern recognition …
-
Completion and validation of the design of a reconfigurable image processing board
… to communicate visually using sign language or lip reading over the telephone network. The Image Processing Board (IPB) is the 'Brain' of the whole system. The IPB processes a given frame of an image to transmit only selected data. It uses the pseudo-laplacian operator, invented by Dr. Nadler, …
-
Classroom communication and academic performance of learners with impairments: A case of Solwezi and Munali Secondary Schoosl
… techniques that were used included verbal, lip-reading, writing, body language, gestures and sign language. As regards to availability of learning materials, there was inadequate teaching and learning materials. The classroom environment did not support classroom communication. Concerning …
-
A metacognitive approach to hearing and listening in older adults
… emerged as a key moderator: strategies like lip-reading, although objectively beneficial, were less likely to be adopted when judged as too demanding. Study 5 developed and validated the Listening Challenges Attitude Scale (LiCAS), a novel tool to assess beliefs about listening difficulties, …
-
Learning from videos with deep convolutional LSTM networks
… convolution LSTMs for action recognition and lipreading demonstrate the model is capable of selectively choosing which spatiotemporal scales are most relevant for a particular dataset. The proposed deep architecture also holds promise in other applications where spatiotemporal features play a …
-
Outcomes of Auditory Brainstem Implantation in Adults with Postlingual Deafness: A Systematic Review
… patients, especially in combination with lip reading. Standardization of speech-recognition performance testing and clinical case reporting will be crucial to make more definitive statements about the factors that influence these outcomes, as the indications for ABI implantation in both …
-
Exploring the Sensing Capability of Wireless Signals
… able to do fine-grained motion sensing like leap reading on smartphones using the CSI dynamics generated by human movements. WiTalk proposes a new fine-grained human motion sensing technique with the distinct context-free feature. To achieve this goal using CSI, WiTalk generates CSI spectrograms …
-
Speech enhancement using multisensory cooperative computing
… A transfer-learning fusion framework maps visual lip movements to speech representations with enhanced temporal modelling. Nonlinear transfer functions and a multi-objective loss incorporating mutual information strengthen cross-modal attention. The resulting system improves generalisation, …