Topic mining and categorization in online discussion forums

Online Forums provide a useful way to engage in discussions about a wide variety of topics, as well as gather custom information for which an exact source may not be available, using a combination of knowledge and human interpretation. Usually forums have categories which cater to a particular topic of interest, allowing information seekers and topic experts to meet. It is thus imperative to organize forum data into an organized structure. In this work we look at methods for categorizing forum posts into appropriate categories, where the number of such categories is large. We compare several baseline methods with state-of-the-art deep learning methods and analyze their performance. We observe that given the highly keyword-centric nature of our data, deep learning methods only slightly outperform baseline methods. Following this, we perform topic modeling on the forum data to find latent topics which creates a hierarchy across forum categories and clusters similar categories. In this process we observe that some of the recent approaches in topic modeling that utilize word embeddings lead to better topics. Finally, we use this hierarchy to perform hierarchical classification of the forum posts to allow better management of the classification task and analyze the benefits of this method.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2020

Author dc:creator

• Dey, Jishnu

Contributors dc:contributor

• Zhai, ChengXiang

• discussion forums
• topic modeling
• text categorization
• hierarchical categorization

Statement dc:rights

• Copyright 2020 Jishnu Dey

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/108348

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/108348