{"id":{"repo_id":"nus","oai_identifier":"oai:scholarbank.nus.edu.sg:10635/43742"},"canonical_url":"https://search.dev.ndltd.org/etd/nus/oai:scholarbank.nus.edu.sg:10635/43742","repository":{"repo_id":"nus","name":"National University of Singapore","base_url":"https://scholarbank.nus.edu.sg/oai/request"},"display":{"title":"Variational Approximation for Complex Regression Models","abstract":"The trend towards collecting large datasets has resulted in the need for more flexible models and fast computational approximations. My thesis reflects these themes by considering some very flexible regression models and developing fast variational approximation methods for fitting them under a Bayesian framework. Models considered include mixtures of heteroscedastic regression models, mixtures of linear mixed models and generalized linear mixed models. The advantages of variational methods as compared to MCMC methods are illustrated in model fitting, model selection and model criticism. In addition, we show that the use of reparametrization techniques such as hierarchical centering and partially noncentered parametrizations, which have been used to accelerate MCMC and EM algorithms for hierarchical models, can lead to improved convergence in variational algorithms as well. Finally, we demonstrate how stochastic approximation can be combined with variational methods to improve the accuracy of posterior approximations and make variational inference a viable approach for large datasets.","abstract_html":"The trend towards collecting large datasets has resulted in the need for more flexible models and fast computational approximations. My thesis reflects these themes by considering some very flexible regression models and developing fast variational approximation methods for fitting them under a Bayesian framework. Models considered include mixtures of heteroscedastic regression models, mixtures of linear mixed models and generalized linear mixed models. The advantages of variational methods as compared to MCMC methods are illustrated in model fitting, model selection and model criticism. In addition, we show that the use of reparametrization techniques such as hierarchical centering and partially noncentered parametrizations, which have been used to accelerate MCMC and EM algorithms for hierarchical models, can lead to improved convergence in variational algorithms as well. Finally, we demonstrate how stochastic approximation can be combined with variational methods to improve the accuracy of posterior approximations and make variational inference a viable approach for large datasets.","abstract_has_math":false,"creators":["TAN SIEW LI, LINDA"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2013,"date_issued":"2013-07-02","date_published":"2013-07-02","updated_at":"2026-07-24T03:31:26Z","subjects":["Generalized linear mixed models, Mixture models, Heteroscedastic models, Variational Bayes, Stochastic approximation, Reparametrization techniques"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":null,"outbound_label":null,"outbound_source":null},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["TAN SIEW LI, LINDA"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.issued","label":"Date","values":["2013-07-02"]},{"key":"dc:relation.isreferencedby","label":"Dc Relation Isreferencedby","values":["https://scholarbank.nus.edu.sg/handle/10635/43742"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Generalized linear mixed models, Mixture models, Heteroscedastic models, Variational Bayes, Stochastic approximation, Reparametrization techniques"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://scholarbank.nus.edu.sg/bitstreams/22ae0987-2017-4d24-a1c8-3ae7bd4082cf/download"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["The trend towards collecting large datasets has resulted in the need for more flexible models and fast computational approximations. My thesis reflects these themes by considering some very flexible regression models and developing fast variational approximation methods for fitting them under a Bayesian framework. Models considered include mixtures of heteroscedastic regression models, mixtures of linear mixed models and generalized linear mixed models. The advantages of variational methods as compared to MCMC methods are illustrated in model fitting, model selection and model criticism. In addition, we show that the use of reparametrization techniques such as hierarchical centering and partially noncentered parametrizations, which have been used to accelerate MCMC and EM algorithms for hierarchical models, can lead to improved convergence in variational algorithms as well. Finally, we demonstrate how stochastic approximation can be combined with variational methods to improve the accuracy of posterior approximations and make variational inference a viable approach for large datasets."]},{"key":"dc:format.checksum.md5","label":"Dc Format Checksum Md5","values":["b57756b53b974e252ea1be89bbdbb577","9a9f0d19a7d9e474d7908cedefc8fdae"]},{"key":"dc:title","label":"Title","values":["Variational Approximation for Complex Regression Models"]}]}],"canonical_facts":{"dc:creator":["TAN SIEW LI, LINDA"],"dc:date.issued":["2013-07-02"],"dc:description.abstract":["The trend towards collecting large datasets has resulted in the need for more flexible models and fast computational approximations. My thesis reflects these themes by considering some very flexible regression models and developing fast variational approximation methods for fitting them under a Bayesian framework. Models considered include mixtures of heteroscedastic regression models, mixtures of linear mixed models and generalized linear mixed models. The advantages of variational methods as compared to MCMC methods are illustrated in model fitting, model selection and model criticism. In addition, we show that the use of reparametrization techniques such as hierarchical centering and partially noncentered parametrizations, which have been used to accelerate MCMC and EM algorithms for hierarchical models, can lead to improved convergence in variational algorithms as well. Finally, we demonstrate how stochastic approximation can be combined with variational methods to improve the accuracy of posterior approximations and make variational inference a viable approach for large datasets."],"dc:format.checksum.md5":["b57756b53b974e252ea1be89bbdbb577","9a9f0d19a7d9e474d7908cedefc8fdae"],"dc:identifier.uri":["https://scholarbank.nus.edu.sg/bitstreams/22ae0987-2017-4d24-a1c8-3ae7bd4082cf/download"],"dc:relation.isreferencedby":["https://scholarbank.nus.edu.sg/handle/10635/43742"],"dc:subject":["Generalized linear mixed models, Mixture models, Heteroscedastic models, Variational Bayes, Stochastic approximation, Reparametrization techniques"],"dc:title":["Variational Approximation for Complex Regression Models"],"dc:type":["Thesis"]},"updated_at":"2026-07-24T03:31:26Z"}