Quantitatively Motivated Model Development Framework: Downstream Analysis Effects of Normalization Strategies

<p>Through a review of epistemological frameworks in social sciences, history of frameworks in statistics, as well as the current state of research, we establish that there appears to be no consistent, quantitatively motivated model development framework in data science, and the downstream analysis effects of various modeling choices are not uniformly documented. Examples are provided which illustrate that analytic choices, even if justifiable and statistically valid, have a downstream analysis effect on model results. This study proposes a unified model development framework that allows researchers to make statistically motivated modeling choices within the development pipeline. Additionally, a simulation study is used to determine empirical justification of the proposed framework. This study tests the utility of the proposed framework by investigating the effects of normalization on downstream analysis results. Normalization methods are investigated by utilizing a decomposition of the empirical risk functions, measuring effects on model bias, variance, and irreducible error. Measurements of bias and variance are then applied as diagnostic procedures for model pre-processing and development within the unified framework. Findings from simulation results are included in the proposed framework and stress-tested on benchmark datasets as well as several applications.</p>

Name thesis:degree_name

Doctor of Philosophy in Analytic and Data Science

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Statistics and Analytical Sciences

Year dc:date.available

2020

Author dc:creator

• Rudd, Jessica M

Contributors dc:contributor

• Herman Ray
• Jennifer Priestley
• Lin Li

• theoretical framework
• bias-variance decomposition
• empirical analysis
• downstream analysis effects
• Analysis
• Data Science
• Other Applied Mathematics
• Statistics and Probability

Repository record dc:identifier

https://digitalcommons.kennesaw.edu/dataphd_etd/9

OAI identifier oai:identifier

oai:digitalcommons.kennesaw.edu:dataphd_etd-1008