Probabilistic inference via sum-product algorithms on binary pairwise Gibbs random fields with applications to multiple fault diagnosis

In this dissertation, we consider probabilistic inference problems on binary pairwise Gibbs random fields (BPW-GRFs), which belong to a class of Markov random fields with applications to a large variety of systems, including computer vision, statistical mechanics, modeling of neural functions, and others. In particular, we study the application of iterative heuristic sum-product algorithms (SPAs) to the underlying graphs for solving the marginal problem on BPW-GRFs. These algorithms operate on the BPW-GRF graph by propagating messages along the edges and by using them to update the beliefs at each node of the graph; these beliefs then serve as suboptimal solutions to the marginal problem. SPAs offer several advantages such as complexity that is polynomial in the number of nodes and edges in the graph and the ability to operate in a distributed fashion (determined by the structure of the underlying graph). In general, the analysis of SPAs can be categorized into (i) finding conditions under which the SPAs converge, and (ii) determining the correctness of the marginal solutions provided by the SPAs with respect to the true marginals. In this dissertation, we consider both problems. For each problem, we first review existing results and then present our specific contribution within the class of BPW-GRFs. Finally, we extend our analysis of SPAs on BPW-GRFs to the application of multiple fault diagnosis (note that the equivalent GRFs for fault diagnosis systems are typically non-binary). In particular, we establish tighter bounds over previous results, and show that fault diagnosis using SPA beliefs (as suboptimal solutions to the true marginals) can detect multiple faults with very high accuracy.

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Electrical & Computer Engr

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2011

Author dc:creator

• Le, Tung

Contributors dc:contributor

• Hadjicostis, Christoforos N.
• Basar, Tamer
• Tatikonda, Sekhar C.
• Veeravalli, Venugopal V.

• Probabilistic inference
• marginal problems
• marginal bounds
• graphical models
• Markov random fields
• Gibbs random fields
• binary pairwise Gibbs random fields
• belief propagation
• sum-product algorithms
• fault diagnosis

Statement dc:rights

• Copyright 2010 Tung Le

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/18543

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/18543