Structured prediction with indirect supervision

Structured tasks, which often involve many interdependent decisions for each example, are the backbone for many important applications such as natural language processing tasks. The models built for structured tasks need to be capable of assigning values to a set of interdependent variables. In this thesis, we point out that the strong dependencies between the decisions in structured tasks can be exploited to simplify both the learning task and the annotation effort --- it is sometimes possible to supply partial and indirect supervision to only some of the target variables or to other variables that are derivatives of the target variables and thus reduce the supervision effort significantly. Based on this intuition, this thesis addresses the problem of reducing the cost of labeling for structural tasks. We tackle this problem by developing advanced machine learning algorithms that can learn and generalize from indirect supervision in addition to labeled data. Indirect supervision can come in the form of constraints or weaker supervision signals. Our proposed learning frameworks can handle both structured output problems and problems with latent structures. We demonstrate the effectiveness of the learning with indirect supervision framework for many natural language processing tasks.

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2012

Author dc:creator

• Chang, Ming-Wei

Contributors dc:contributor

• Roth, Dan
• DeJong, Gerald F.
• Hoiem, Derek W.
• Smith, Noah

• Machine learning
• natural language processing
• structural learning
• indirect supervision
• constraint driven learning

Statement dc:rights

• Copyright 2011 Ming-Wei Chang

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/29768

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/29768