Beyond the Checkbox: Leveraging AI Chatbots for Inclusive Demographic Data Collection

Traditional demographic surveys compress rich identities into rigid checkboxes. This dissertation asks whether a conversational chatbot, powered by GPT-4o, can restore that nuance. In a within-subjects experiment, 230 participants completed both a chatbot conversation and the standard Office of Management and Budget (OMB) form. Exploratory analyses showed that participants' open-ended narratives frequently moved beyond the OMB labels. By encoding these responses with the INSTRUCTOR embedding model, and organizing them via hierarchical clustering, the categorization can be "cut" at multiple levels of granularity, producing solutions that can satisfy regulatory reporting and finer leaves that reveal national, regional, and mixed-heritage detail. Hypothesis-driven tests of user experience reinforced these advantages. On the User Experience Questionnaire, the chatbot outscored the demographic checklist on hedonic qualities, novelty, and stimulation, while the checklist retained pragmatic strengths such as dependability. Perceived group inclusivity also rose when data were collected through the chatbot, regardless of how closely respondents' identities aligned with OMB categories. Overall, the findings indicate that a carefully engineered chatbot, paired with advanced natural-language-processing analyses, can enhance race and ethnicity data collection by producing richer information and fostering a more inclusive, engaging respondent experience.

Name thesis:degree_name

Doctor of Philosophy

Level thesis:degree_level

doctoral

Discipline thesis:degree_discipline

Psychology

Department dc:contributor.department

Psychology

Grantor dc:publisher

Virginia Tech

Year dc:date.issued

2025

Author dc:creator

• Chekili, Amel

Chair dc:contributor.committeechair

• Hernandez, Jorge Ivan

Committee members dc:contributor.committeemember

• Diana, Rachel A.
• Hickman, Louis
• Hsu, Ning

• Chatbots
• Demographic data collection
• Race
• Ethnicity
• Natural language processing
• Inclusivity

Statement dc:rights

• Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International

Licence dc:rights.uri

• http://creativecommons.org/licenses/by-nc-nd/4.0/

Language dc:language.iso

en

Dc Identifier Other

vt_gsexam:44388

OAI identifier oai:identifier

oai:vtechworks.lib.vt.edu:10919/137810