User-guided dynamic topic discovery in large texts

Dynamic topic models (DTMs) play a crucial role in generating insights from large timestamped corpora of text by capturing the evolution of topics over time. Despite their popularity, existing DTMs are fully unsupervised, resulting in generated topic evolutions that often do not cater to a user’s needs. Additionally, the topic evolutions produced by DTMs tend to contain generic terms that do not accurately represent their designated time steps. This is particularly problematic as DTMs are frequently employed for analyzing the evolution of specific topics within a corpus. To address these challenges, we propose ReGenT, a framework for Dynamic, Discriminative Topic Discovery. This task aims to discover topic evolutions from temporal corpora that align with a set of user-provided category names while uniquely capturing topics at each time step. We accomplish this by (1) utilizing a retrieval-QA framework to retrieve relevant words for seeds with high granularity, (2) automatically generating and ranking strong questions to probe future words to expand our initial word set, (3) ensuring that the mined words are distinctly popular at a given time, and (4) iteratively refining our word list through ensemble ranking. We conduct experiments on two diverse datasets and demonstrate that ReGenT achieves state-of-the-art performance through extensive evaluations.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2023

Author dc:creator

• Venkat Ramanan, Karthik

Contributors dc:contributor

• Han, Jiawei

• Information Retrieval
• Question Answering
• Natural Language Processing
• Data Mining
• Pretrained Language Models
• Topic Modeling

Statement dc:rights

• Copyright 2023 Karthik Venkat Ramanan

Language dc:language

en, eng

Handle dc:identifier

https://hdl.handle.net/2142/120590

OAI record oai:identifier

https://www.ideals.illinois.edu/oai-pmh?verb=GetRecord&metadataPrefix=etdms&identifier=oai%3Awww.ideals.illinois.edu%3A2142%2F120590