Model sensitivity to prior selection in replication studies
type: CreativeWork
description: When doing a Bayesian Analysis for a replication study, selecting priors is a widely discussed issue. On one hand, we could argue that an informative prior specified by previous research is preferable because we have some knowledge and expectations regarding the phenomena. However, when the goal is to replicate findings from previous research, we do not want to use prior findings to influence results of the replication study; that is, for a replication study, we should use a non-informative prior, which would maximize the utility of current data. By analyzing a replication research for a widely cited psycholinguistics paper (Fine, Jaeger, Qian, & Farmer, 2013), this thesis aims to provide insight as to how a replication researcher might go about selecting priors for analyzing replication studies within a Bayesian framework. By using sensitivity analyses, posterior predictive checking, and information criteria, researchers can start with a more reasonable prior setting that eventually leads to more valid confirmation or non-confirmation of previous research.
abstract: When doing a Bayesian Analysis for a replication study, selecting priors is a widely discussed issue. On one hand, we could argue that an informative prior specified by previous research is preferable because we have some knowledge and expectations regarding the phenomena. However, when the goal is to replicate findings from previous research, we do not want to use prior findings to influence results of the replication study; that is, for a replication study, we should use a non-informative prior, which would maximize the utility of current data. By analyzing a replication research for a widely cited psycholinguistics paper (Fine, Jaeger, Qian, & Farmer, 2013), this thesis aims to provide insight as to how a replication researcher might go about selecting priors for analyzing replication studies within a Bayesian framework. By using sensitivity analyses, posterior predictive checking, and information criteria, researchers can start with a more reasonable prior setting that eventually leads to more valid confirmation or non-confirmation of previous research.
author: Liu, Ella
language: en
keywords: Replication Study, Bayesian Analysis, Prior Selection
date published: 2019-11-26T20:49:14Z
date modified: 2026-07-22T22:24:45Z
provider: University of Illinois - Urbana-Champaign
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: University of Illinois at Urbana-Champaign

PropertyValue
property ID: Handle
value: http://hdl.handle.net/2142/105756