DPLearn: an effective but concise learning framework based on discriminative patterns

Pattern-based classification was originally proposed to improve the accuracy using selected frequent patterns, where many efforts were paid to prune a huge number of non-discriminative frequent patterns. On the other hand, tree-based models have shown strong abilities on many learning tasks since they can easily build high-order interactions between different features and also handle both numerical and categorical features as well as high dimensional features. By taking the advantage of both modeling methodologies, a natural and effective way is proposed to resolve pattern-based learning tasks by adopting discriminative patterns which are the prefix paths from root to nodes in tree-based models (e.g., random forest). Moreover, the number of discriminative patterns is further compressed by selecting the most effective pattern combinations that fit into a generalized linear model. Note that this method is a general framework, which is applicable on both classification and regression tasks by using different loss functions. Extensive experiments demonstrate that the discriminative pattern-based learning framework (DPLearn) could perform as good as previous state-of-the-art algorithms, provide great interpretability by utilizing only very limited number of discriminative patterns, and predict new data extremely fast. More specifically, in classification tasks, DPLearn could gain even better accuracy by only using top-20 discriminative patterns, while in regression tasks DPLearn delivers reasonable performance that is comparable to complex models, which shows that framework so generated is very concise and highly explanatory to human experts.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2016

Author dc:creator

• Tong, Wenzhu

Contributors dc:contributor

• Han, Jiawei

• DPLearn
• discriminative patterns

Statement dc:rights

• Copyright 2016 Wenzhu Tong

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/90800

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/90800