Temporal Topic Embeddings with a Compass

Aligning Word2vec word embeddings using a compass in a system of Compass-aligned Distributional Embeddings (CADE) creates stable and accurate temporal word embeddings. This thesis seeks to expand the CADE framework into the area of dynamic topic modeling (DTM), where temporal word2vec embeddings can be used to describe temporally and unsupervised evolving topics. It also seeks to improve upon the CADE framework through a theoretical and experimental exploration of compass parameters, cluster and topic generation techniques, and topic descriptor creation. This method of Temporal Topic Embeddings with a Compass (TTEC) will be compared to other DTM techniques in the ability to create coherent and diverse clusters and will be shown to be competitive compared to traditional and transformer-aided DTM architectures. In addition to a qualitative discussion of results, there will be a political theoretical overview of the nature of this technique and potential use cases, with interviews from political actors of various backgrounds as to how the technique and machine learning as a whole can be used in the organizational setting.

Name thesis:degree_name

Master of Science

Level thesis:degree_level

masters

Discipline thesis:degree_discipline

Computer Science & Applications

Department dc:contributor.department

Computer Science and#38; Applications

Grantor dc:publisher

Virginia Tech

Year dc:date.issued

2024

Author dc:creator

• Palamarchuk, Daniel Andrew

Chair dc:contributor.committeechair

• North, Christopher L.

Committee members dc:contributor.committeemember

• Danielson, Thomas Lee
• Mayer, Brian Benjamin
• Wang, Xuan

• diachronic
• neural network
• hci
• bureaucracy
• legibility

Statement dc:rights

• Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International

Licence dc:rights.uri

• http://creativecommons.org/licenses/by-nc-sa/4.0/

Language dc:language.iso

en

Dc Identifier Other

vt_gsexam:40595

OAI identifier oai:identifier

oai:vtechworks.lib.vt.edu:10919/119057