{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/87864"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/87864","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Choosing Between the Fixed-, Random-, and Mixed-Effects Model in Meta-Analysis: An Analysis of Existing and New Model Selection Methods","abstract":"The purpose of this thesis is to examine various model selection methods in the context of meta-analysis. Four different models are commonly thought to describe the structure underlying a collection of effect size estimates, namely the fixed-effects, the fixed-effects with moderators, the random-effects, and the mixed-effects model. First, the four meta-analytic models are shown to be special cases of the general linear mixed-effects model (GLMM), allowing the application of the general GLMM theory to meta-analytic models. Second, five heterogeneity estimators are examined in terms of their bias, variance, and mean-squared error. Third, four different homogeneity tests are examined in terms of their Type I error and power. Finally, a bottom-up and a top-down model selection strategy are outlined and compared to determine their accuracy in identifying the correct model. The major findings are as follows. Within the class of approximately unbiased estimators, the restricted maximum-likelihood (REML) estimator is found to be most efficient and has desirable statistical properties such as asymptotic efficiency. The REML estimator can be easily found via the Fisher scoring algorithm, which is robust to poor starting values and has good convergence properties. With respect to the homogeneity tests, the commonly used Q test is recommended. As long as the within-study sample sizes are not too small, the Q test adequately controls the Type I error rate and its power is not exceeded by the other homogeneity tests, such as the likelihood ratio, Wald, and score test. Finally, the bottom-up strategy will often suggest the presence of spurious moderators and therefore can lead to incorrect model selections. On the other hand, the top-down strategy using the mixed-effects model does not suffer from this problem and therefore should be used for model selection and inference purposes.","abstract_html":"The purpose of this thesis is to examine various model selection methods in the context of meta-analysis. Four different models are commonly thought to describe the structure underlying a collection of effect size estimates, namely the fixed-effects, the fixed-effects with moderators, the random-effects, and the mixed-effects model. First, the four meta-analytic models are shown to be special cases of the general linear mixed-effects model (GLMM), allowing the application of the general GLMM theory to meta-analytic models. Second, five heterogeneity estimators are examined in terms of their bias, variance, and mean-squared error. Third, four different homogeneity tests are examined in terms of their Type I error and power. Finally, a bottom-up and a top-down model selection strategy are outlined and compared to determine their accuracy in identifying the correct model. The major findings are as follows. Within the class of approximately unbiased estimators, the restricted maximum-likelihood (REML) estimator is found to be most efficient and has desirable statistical properties such as asymptotic efficiency. The REML estimator can be easily found via the Fisher scoring algorithm, which is robust to poor starting values and has good convergence properties. With respect to the homogeneity tests, the commonly used Q test is recommended. As long as the within-study sample sizes are not too small, the Q test adequately controls the Type I error rate and its power is not exceeded by the other homogeneity tests, such as the likelihood ratio, Wald, and score test. Finally, the bottom-up strategy will often suggest the presence of spurious moderators and therefore can lead to incorrect model selections. On the other hand, the top-down strategy using the mixed-effects model does not suffer from this problem and therefore should be used for model selection and inference purposes.","abstract_has_math":false,"creators":["Viechtbauer, Wolfgang"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":null,"degree_department":null,"school":null,"contributors":["David Budescu"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2015,"date_issued":"2015-09-28T21:56:17Z","date_published":"2015-09-28T21:56:17Z","updated_at":"2026-07-22T22:26:31Z","subjects":["Statistics"],"languages":["eng"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["(MiAaPQ)AAI3153449"],"render_values":[{"text":"(MiAaPQ)AAI3153449","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/2142/87864","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["David Budescu"]},{"key":"dc:creator","label":"Author","values":["Viechtbauer, Wolfgang"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2015-09-28T21:56:17Z","10000-01-01","2004"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Statistics"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/87864","(MiAaPQ)AAI3153449"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The purpose of this thesis is to examine various model selection methods in the context of meta-analysis. Four different models are commonly thought to describe the structure underlying a collection of effect size estimates, namely the fixed-effects, the fixed-effects with moderators, the random-effects, and the mixed-effects model. First, the four meta-analytic models are shown to be special cases of the general linear mixed-effects model (GLMM), allowing the application of the general GLMM theory to meta-analytic models. Second, five heterogeneity estimators are examined in terms of their bias, variance, and mean-squared error. Third, four different homogeneity tests are examined in terms of their Type I error and power. Finally, a bottom-up and a top-down model selection strategy are outlined and compared to determine their accuracy in identifying the correct model. The major findings are as follows. Within the class of approximately unbiased estimators, the restricted maximum-likelihood (REML) estimator is found to be most efficient and has desirable statistical properties such as asymptotic efficiency. The REML estimator can be easily found via the Fisher scoring algorithm, which is robust to poor starting values and has good convergence properties. With respect to the homogeneity tests, the commonly used Q test is recommended. As long as the within-study sample sizes are not too small, the Q test adequately controls the Type I error rate and its power is not exceeded by the other homogeneity tests, such as the likelihood ratio, Wald, and score test. Finally, the bottom-up strategy will often suggest the presence of spurious moderators and therefore can lead to incorrect model selections. On the other hand, the top-down strategy using the mixed-effects model does not suffer from this problem and therefore should be used for model selection and inference purposes.","Made available in DSpace on 2015-09-28T21:56:17Z (GMT). No. of bitstreams: 2 license.txt: 4848 bytes, checksum: 96035ab3f5e1c23cc7138a224ce498bd (MD5) 3153449.pdf: 8148383 bytes, checksum: 3c5581f3c70827c01e1a48b788ba48d9 (MD5) Previous issue date: 2004","Embargo set by: Seth Robbins for item 89145 Lift date: Forever Reason: Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","U of I Only","185 p.","Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 2004."]},{"key":"dc:title","label":"Title","values":["Choosing Between the Fixed-, Random-, and Mixed-Effects Model in Meta-Analysis: An Analysis of Existing and New Model Selection Methods"]}]}],"canonical_facts":{"dc:contributor":["David Budescu"],"dc:creator":["Viechtbauer, Wolfgang"],"dc:date":["2015-09-28T21:56:17Z","10000-01-01","2004"],"dc:description":["The purpose of this thesis is to examine various model selection methods in the context of meta-analysis. Four different models are commonly thought to describe the structure underlying a collection of effect size estimates, namely the fixed-effects, the fixed-effects with moderators, the random-effects, and the mixed-effects model. First, the four meta-analytic models are shown to be special cases of the general linear mixed-effects model (GLMM), allowing the application of the general GLMM theory to meta-analytic models. Second, five heterogeneity estimators are examined in terms of their bias, variance, and mean-squared error. Third, four different homogeneity tests are examined in terms of their Type I error and power. Finally, a bottom-up and a top-down model selection strategy are outlined and compared to determine their accuracy in identifying the correct model. The major findings are as follows. Within the class of approximately unbiased estimators, the restricted maximum-likelihood (REML) estimator is found to be most efficient and has desirable statistical properties such as asymptotic efficiency. The REML estimator can be easily found via the Fisher scoring algorithm, which is robust to poor starting values and has good convergence properties. With respect to the homogeneity tests, the commonly used Q test is recommended. As long as the within-study sample sizes are not too small, the Q test adequately controls the Type I error rate and its power is not exceeded by the other homogeneity tests, such as the likelihood ratio, Wald, and score test. Finally, the bottom-up strategy will often suggest the presence of spurious moderators and therefore can lead to incorrect model selections. On the other hand, the top-down strategy using the mixed-effects model does not suffer from this problem and therefore should be used for model selection and inference purposes.","Made available in DSpace on 2015-09-28T21:56:17Z (GMT). No. of bitstreams: 2 license.txt: 4848 bytes, checksum: 96035ab3f5e1c23cc7138a224ce498bd (MD5) 3153449.pdf: 8148383 bytes, checksum: 3c5581f3c70827c01e1a48b788ba48d9 (MD5) Previous issue date: 2004","Embargo set by: Seth Robbins for item 89145 Lift date: Forever Reason: Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","Restricted to the U of I community idenfinitely during batch ingest of legacy ETDs","U of I Only","185 p.","Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 2004."],"dc:identifier":["http://hdl.handle.net/2142/87864","(MiAaPQ)AAI3153449"],"dc:language":["eng"],"dc:subject":["Statistics"],"dc:title":["Choosing Between the Fixed-, Random-, and Mixed-Effects Model in Meta-Analysis: An Analysis of Existing and New Model Selection Methods"],"dc:type":["text"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:26:31Z"}