Boosted ensemble algorithm strategically trained for the incremental learning of unbalanced data

<p>Many pattern classification problems require a solution that needs to be incrementally updated over a period of time. Incremental learning problems are often complicated by the appearance of new concept classes and unbalanced cardinality in training data. The purpose of this research is to develop an algorithm capable of incrementally learning from severely unbalanced data. This work introduces three novel ensemble based algorithms derived from the incremental learning algorithm, Learn++. Learn++.NC is designed specifically for incrementally learning <em>N</em>ew <em>C</em>lasses through dynamically adjusting the combination weights of the classifiers' decisions. Learn++.UD handles <em>U</em>nbalanced <em>D</em>ata through class-conditional voting weights that are proportional to the cardinality differences among <em>training datasets</em>. Finally, we introduce the <em>B</em>oosted <em>E</em>nsemble <em>A</em>lgorithm <em>S</em>trategically <em>T</em>rained (BEAST) for incremental learning of unbalanced data. BEAST combines Learn++.NC and Learn++.UD with additional strategies that compensate for unbalanced data arising from cardinality differences among concept classes. These three algorithms are investigated both analytically and empirically through a series of simulations. The simulation results are presented, compared and discussed. While Learn++.NC and Learn++.UD perform well on the specific problems they were designed for, BEAST provides a strong and more robust performance on a much broader spectrum of complex incremental learning and unbalanced data problems.</p>

Name thesis:degree_name

M.S. in Engineering

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Electrical & Computer Engineering

Year dc:date.available

2006

Author dc:creator

• Muhlbaier, Michael David

Contributors dc:contributor

• Polikar, Robi

• Electrical engineering--Research; Learning--Mathematical models
• Electrical and Computer Engineering

Repository record dc:identifier

https://rdw.rowan.edu/etd/915

OAI identifier oai:identifier

oai:rdw.rowan.edu:etd-1915