{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/110785"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/110785","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Simultaneous estimation approaches to large-scale multivariate regression","abstract":"Large-scale multivariate regression has various applications in machine learning fields, especially in image recognition, gene expression prediction and multivariate time series prediction. Numerous approaches have been developed to solve this problem. Some popular statistical methods are group lasso and multivariate ridge regression. Most existing methods either leverage the information of the error covariance matrix or assume specific parameter structures. However, in practice, this information is not available. To resolve these issues, we start with formulating multivariate regression as a compound decision problem. In Chapter 2, we propose an empirical Bayes-based approach where the prior distribution of unknown parameters is estimated nonparametrically from the data. Unlike existing methods, the proposed method does not assume any structure of parameters. In Chapter 3, we propose a method that linearly shrinks each coordinate of ordinary least squares estimator. Both theoretical and numerical results are available. In Chapter 4, some nonlinear shrinkage methods based on soft threshold operator are also proposed. Taking the advantage of large number of related outcomes, the proposed methods outperform popular existing methods.","abstract_html":"Large-scale multivariate regression has various applications in machine learning fields, especially in image recognition, gene expression prediction and multivariate time series prediction. Numerous approaches have been developed to solve this problem. Some popular statistical methods are group lasso and multivariate ridge regression. Most existing methods either leverage the information of the error covariance matrix or assume specific parameter structures. However, in practice, this information is not available. To resolve these issues, we start with formulating multivariate regression as a compound decision problem. In Chapter 2, we propose an empirical Bayes-based approach where the prior distribution of unknown parameters is estimated nonparametrically from the data. Unlike existing methods, the proposed method does not assume any structure of parameters. In Chapter 3, we propose a method that linearly shrinks each coordinate of ordinary least squares estimator. Both theoretical and numerical results are available. In Chapter 4, some nonlinear shrinkage methods based on soft threshold operator are also proposed. Taking the advantage of large number of related outcomes, the proposed methods outperform popular existing methods.","abstract_has_math":false,"creators":["Wang, Yihe"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Statistics","degree_department":null,"school":null,"contributors":["Zhao, Sihai Dave","Liang, Feng","Eck, Daniel J","Zhu, Ruoqing"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-09-17T04:04:05Z","date_published":"2021-09-17T04:04:05Z","updated_at":"2026-07-22T22:24:52Z","subjects":["multivariate regression","compound decision","nonparametric","empirical Bayes","Stein's unbiased risk"],"languages":["en"],"rights":["Copyright 2021 Yihe Wang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/110785","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Zhao, Sihai Dave","Liang, Feng","Eck, Daniel J","Zhu, Ruoqing"]},{"key":"dc:creator","label":"Author","values":["Wang, Yihe"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-09-17T04:04:05Z","2023-09-17T04:07:01Z","2021-03-30","2021-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Statistics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["multivariate regression","compound decision","nonparametric","empirical Bayes","Stein's unbiased risk"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2021 Yihe Wang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/110785"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Large-scale multivariate regression has various applications in machine learning fields, especially in image recognition, gene expression prediction and multivariate time series prediction. Numerous approaches have been developed to solve this problem. Some popular statistical methods are group lasso and multivariate ridge regression. Most existing methods either leverage the information of the error covariance matrix or assume specific parameter structures. However, in practice, this information is not available. To resolve these issues, we start with formulating multivariate regression as a compound decision problem. In Chapter 2, we propose an empirical Bayes-based approach where the prior distribution of unknown parameters is estimated nonparametrically from the data. Unlike existing methods, the proposed method does not assume any structure of parameters. In Chapter 3, we propose a method that linearly shrinks each coordinate of ordinary least squares estimator. Both theoretical and numerical results are available. In Chapter 4, some nonlinear shrinkage methods based on soft threshold operator are also proposed. Taking the advantage of large number of related outcomes, the proposed methods outperform popular existing methods.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2023-05-01","The student, Yihe Wang, accepted the attached license on 2021-03-26 at 14:14.","The student, Yihe Wang, submitted this Dissertation for approval on 2021-03-26 at 14:23.","This Dissertation was approved for publication on 2021-03-30 at 09:21.","DSpace SAF Submission Ingestion Package generated from Vireo submission #16214 on 2021-09-16 at 20:07:51","Made available in DSpace on 2021-09-17T04:04:05Z (GMT). No. of bitstreams: 2 WANG-DISSERTATION-2021.pdf: 2631668 bytes, checksum: c6bfd606fee117ce49bf41b6c956ee2d (MD5) LICENSE.txt: 4206 bytes, checksum: 80e591243bc13266b37bdf9ef92f5193 (MD5) Previous issue date: 2021-03-30","Embargo set by: Seth Robbins for item 118630 Lift date: 2023-09-17T04:04:53Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 118630 Lift date: 2023-09-17T04:07:01Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Simultaneous estimation approaches to large-scale multivariate regression"]}]}],"canonical_facts":{"dc:contributor":["Zhao, Sihai Dave","Liang, Feng","Eck, Daniel J","Zhu, Ruoqing"],"dc:creator":["Wang, Yihe"],"dc:date":["2021-09-17T04:04:05Z","2023-09-17T04:07:01Z","2021-03-30","2021-05"],"dc:description":["Large-scale multivariate regression has various applications in machine learning fields, especially in image recognition, gene expression prediction and multivariate time series prediction. Numerous approaches have been developed to solve this problem. Some popular statistical methods are group lasso and multivariate ridge regression. Most existing methods either leverage the information of the error covariance matrix or assume specific parameter structures. However, in practice, this information is not available. To resolve these issues, we start with formulating multivariate regression as a compound decision problem. In Chapter 2, we propose an empirical Bayes-based approach where the prior distribution of unknown parameters is estimated nonparametrically from the data. Unlike existing methods, the proposed method does not assume any structure of parameters. In Chapter 3, we propose a method that linearly shrinks each coordinate of ordinary least squares estimator. Both theoretical and numerical results are available. In Chapter 4, some nonlinear shrinkage methods based on soft threshold operator are also proposed. Taking the advantage of large number of related outcomes, the proposed methods outperform popular existing methods.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2023-05-01","The student, Yihe Wang, accepted the attached license on 2021-03-26 at 14:14.","The student, Yihe Wang, submitted this Dissertation for approval on 2021-03-26 at 14:23.","This Dissertation was approved for publication on 2021-03-30 at 09:21.","DSpace SAF Submission Ingestion Package generated from Vireo submission #16214 on 2021-09-16 at 20:07:51","Made available in DSpace on 2021-09-17T04:04:05Z (GMT). No. of bitstreams: 2 WANG-DISSERTATION-2021.pdf: 2631668 bytes, checksum: c6bfd606fee117ce49bf41b6c956ee2d (MD5) LICENSE.txt: 4206 bytes, checksum: 80e591243bc13266b37bdf9ef92f5193 (MD5) Previous issue date: 2021-03-30","Embargo set by: Seth Robbins for item 118630 Lift date: 2023-09-17T04:04:53Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 118630 Lift date: 2023-09-17T04:07:01Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/110785"],"dc:language":["en"],"dc:rights":["Copyright 2021 Yihe Wang"],"dc:subject":["multivariate regression","compound decision","nonparametric","empirical Bayes","Stein's unbiased risk"],"dc:title":["Simultaneous estimation approaches to large-scale multivariate regression"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Statistics"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:52Z"}