{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/92827"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/92827","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Scalable algorithms for Bayesian variable selection","abstract":"This Dissertation was approved for publication on 2016-07-14 at 08:43.","abstract_html":"This Dissertation was approved for publication on 2016-07-14 at 08:43.","abstract_has_math":false,"creators":["Wang, Jin"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Statistics","degree_department":null,"school":null,"contributors":["Liang, Feng","Marden, John I.","Ji, Yuan","Zhao, Dave","Park, Trevor"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2016,"date_issued":"2016-11-10T17:55:03Z","date_published":"2016-11-10T17:55:03Z","updated_at":"2026-07-22T22:26:35Z","subjects":["Variable Selection","EM","Ensemble","Variational Bayes","Asymptotic Analysis","Logistic model"],"languages":["en"],"rights":["Copyright 2016 Jin Wang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/92827","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Liang, Feng","Marden, John I.","Ji, Yuan","Zhao, Dave","Park, Trevor"]},{"key":"dc:creator","label":"Author","values":["Wang, Jin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2016-11-10T17:55:03Z","2016-07-14","2016-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Statistics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Variable Selection","EM","Ensemble","Variational Bayes","Asymptotic Analysis","Logistic model"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2016 Jin Wang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/92827"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This Dissertation was approved for publication on 2016-07-14 at 08:43.","DSpace SAF Submission Ingestion Package generated from Vireo submission #9914 on 2016-11-09 at 10:24:33","The innovation of modern technologies drives research and development on high-dimensional data analysis in diverse fields, where variable selection plays a pivotal role to ensure credible model estimation. We focus on scalable algorithms for variable selection that can handle large data sets. Firstly, we propose an EM algorithm that returns the MAP estimate of the set of relevant variables. Due to its particular updating scheme, our algorithm can be implemented efficiently. We also show that the MAP estimate returned by our EM algorithm achieves variable selection consistency. In practice, EM algorithm tends to get stuck at local peaks. So we propose an ensemble version: repeatedly apply the EM algorithm on a subset of Bootstrap sample data and then aggregate the results. Empirical studies demonstrate the superior performance of this Bayesian Bootstrap EM algorithm. Secondly, we propose a hybrid computation framework for Bayesian variable selection. This new algorithm SAB is a combination of the classical EM algorithm and the variational Bayes algorithm. It is very fast in handling high dimensional data with a large number of covariates. To address a critical biological problem, we apply SAB to a state-of-art cancer genomics data set with a goal to understand the complex regulatory relationship between miRNAs and mRNAs in cancer. In the third part, we study the asymptotic behavior of the SAB algorithm in detail and prove that SAB achieves the selection consistency, Bayesian consistency and also an oracle property when the number of covariates grows with the sample size exponentially. Lastly, we extend the hybrid framework of Bayesian variable selection to logistic models, where we adopt the Polya-Gamma specification and show that this specification is equivalent as the local approximation method in the variational Bayes framework.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2016-11-09 without embargo terms","The student, Jin Wang, accepted the attached license on 2016-07-12 at 21:46.","The student, Jin Wang, submitted this Dissertation for approval on 2016-07-12 at 21:56.","Made available in DSpace on 2016-11-10T17:55:03Z (GMT). No. of bitstreams: 3 WANG-DISSERTATION-2016.pdf: 2052232 bytes, checksum: 9e3ccb9022c039336ce65d2738f9b905 (MD5) LICENSE.txt: 4205 bytes, checksum: 565d1c630c6df87824a9015f3839fa3b (MD5) PROQUEST_LICENSE.txt: 4551 bytes, checksum: cf5b27ce9c5a86d4562d3652db3d9f57 (MD5) Previous issue date: 2016-07-14"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Scalable algorithms for Bayesian variable selection"]}]}],"canonical_facts":{"dc:contributor":["Liang, Feng","Marden, John I.","Ji, Yuan","Zhao, Dave","Park, Trevor"],"dc:creator":["Wang, Jin"],"dc:date":["2016-11-10T17:55:03Z","2016-07-14","2016-08"],"dc:description":["This Dissertation was approved for publication on 2016-07-14 at 08:43.","DSpace SAF Submission Ingestion Package generated from Vireo submission #9914 on 2016-11-09 at 10:24:33","The innovation of modern technologies drives research and development on high-dimensional data analysis in diverse fields, where variable selection plays a pivotal role to ensure credible model estimation. We focus on scalable algorithms for variable selection that can handle large data sets. Firstly, we propose an EM algorithm that returns the MAP estimate of the set of relevant variables. Due to its particular updating scheme, our algorithm can be implemented efficiently. We also show that the MAP estimate returned by our EM algorithm achieves variable selection consistency. In practice, EM algorithm tends to get stuck at local peaks. So we propose an ensemble version: repeatedly apply the EM algorithm on a subset of Bootstrap sample data and then aggregate the results. Empirical studies demonstrate the superior performance of this Bayesian Bootstrap EM algorithm. Secondly, we propose a hybrid computation framework for Bayesian variable selection. This new algorithm SAB is a combination of the classical EM algorithm and the variational Bayes algorithm. It is very fast in handling high dimensional data with a large number of covariates. To address a critical biological problem, we apply SAB to a state-of-art cancer genomics data set with a goal to understand the complex regulatory relationship between miRNAs and mRNAs in cancer. In the third part, we study the asymptotic behavior of the SAB algorithm in detail and prove that SAB achieves the selection consistency, Bayesian consistency and also an oracle property when the number of covariates grows with the sample size exponentially. Lastly, we extend the hybrid framework of Bayesian variable selection to logistic models, where we adopt the Polya-Gamma specification and show that this specification is equivalent as the local approximation method in the variational Bayes framework.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2016-11-09 without embargo terms","The student, Jin Wang, accepted the attached license on 2016-07-12 at 21:46.","The student, Jin Wang, submitted this Dissertation for approval on 2016-07-12 at 21:56.","Made available in DSpace on 2016-11-10T17:55:03Z (GMT). No. of bitstreams: 3 WANG-DISSERTATION-2016.pdf: 2052232 bytes, checksum: 9e3ccb9022c039336ce65d2738f9b905 (MD5) LICENSE.txt: 4205 bytes, checksum: 565d1c630c6df87824a9015f3839fa3b (MD5) PROQUEST_LICENSE.txt: 4551 bytes, checksum: cf5b27ce9c5a86d4562d3652db3d9f57 (MD5) Previous issue date: 2016-07-14"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/92827"],"dc:language":["en"],"dc:rights":["Copyright 2016 Jin Wang"],"dc:subject":["Variable Selection","EM","Ensemble","Variational Bayes","Asymptotic Analysis","Logistic model"],"dc:title":["Scalable algorithms for Bayesian variable selection"],"dc:type":["text"],"thesis:degree_discipline":["Statistics"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:26:35Z"}