Multiview feature learning for speech recognition

In this thesis, we study the problem of learning a linear transformation of acoustic feature vectors for speech recognition, in a framework where apart from the acoustics, additional views are available at training time. We consider a multiview learning approach based on canonical correlation analysis to learn linear transformations of the acoustic features that are maximally correlated with the data. We propose simple approaches for combining information shared across the views with information that is private to the acoustic view. We apply these methods to a specific scenario in which articulatory data is available at training time. Results of phonetic frame classification on data drawn from the University of Wisconsin X-ray Microbeam Database indicate a small but consistent advantage to the multiview approaches that combine shared and private information, compared to the baseline acoustic features or unsupervised dimensionality reduction using principal component analysis. We then discuss limitations of canonical correlation analysis and possible extensions.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Electrical & Computer Engr

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2012

Author dc:creator

• Bharadwaj, Sujeeth

Contributors dc:contributor

• Hasegawa-Johnson, Mark A.

• Multiview learning
• canonical correlation analysis
• articulatory measurements
• dimensionality reduction
• acoustic features

Statement dc:rights

• Copyright 2011 Sujeeth Bharadwaj

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/29785

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/29785