{"id":{"repo_id":"toronto-retro","oai_identifier":"oai:utoronto.scholaris.ca:1807/68403"},"canonical_url":"https://search.dev.ndltd.org/etd/toronto-retro/oai:utoronto.scholaris.ca:1807/68403","repository":{"repo_id":"toronto-retro","name":"University of Toronto","base_url":"https://utoronto.scholaris.ca/server/oai/request"},"display":{"title":"Kernel Machines are Not Black Boxes - On the Interpretability of Kernel-based Nonparametric Models","abstract":"Kernel-based nonparametric models are often perceived as uninterpretable black boxes. This notion is however questionable; permutation-based variable importance, for example, is one approach for interpreting various nonparametric models. Unfortunately, besides being computationally intensive, permutation-based variable importance is merely a predictor importance measure for supervised regression analysis, and is inapplicable for unsupervised models. This thesis overcomes these issues by using the gradient of kernel-based nonparametric functions to interpret kernel-based models. In particular, the gradient of a kernel regression function can produce variable importance scores with significant computational advantage over permutation-based variable importance. Gradient information can further reveal predictor-response association structure through dimension reduction and graphical analysis; a property not enjoyed by variable importance scores. Most importantly, kernel methods embody a family of supervised and unsupervised learning techniques, and gradient information can be used to interpret not only supervised kernel models, but also unsupervised ones. This fact is demonstrated by using gradient information to interpret the co-dependence structures, as discovered by kernel canonical correlation analysis, between two variable sets.","abstract_html":"Kernel-based nonparametric models are often perceived as uninterpretable black boxes. This notion is however questionable; permutation-based variable importance, for example, is one approach for interpreting various nonparametric models. Unfortunately, besides being computationally intensive, permutation-based variable importance is merely a predictor importance measure for supervised regression analysis, and is inapplicable for unsupervised models. This thesis overcomes these issues by using the gradient of kernel-based nonparametric functions to interpret kernel-based models. In particular, the gradient of a kernel regression function can produce variable importance scores with significant computational advantage over permutation-based variable importance. Gradient information can further reveal predictor-response association structure through dimension reduction and graphical analysis; a property not enjoyed by variable importance scores. Most importantly, kernel methods embody a family of supervised and unsupervised learning techniques, and gradient information can be used to interpret not only supervised kernel models, but also unsupervised ones. This fact is demonstrated by using gradient information to interpret the co-dependence structures, as discovered by kernel canonical correlation analysis, between two variable sets.","abstract_has_math":false,"creators":["Chang, Billy Heung Wing"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Dalla Lana School of Public Health","school":null,"contributors":[],"advisors":["Rafal, Kustra"],"committee_chairs":[],"committee_members":[],"year":2014,"date_issued":"2014-11","date_published":"2014-11","updated_at":"2026-07-27T21:27:52Z","subjects":["Canonical Correlation Analysis","Dimension Reduction","Kernel Machines","Nonparametric Regression","Variable Importance"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1807/68403","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Rafal, Kustra"]},{"key":"dc:contributor.department","label":"Department","values":["Dalla Lana School of Public Health"]},{"key":"dc:creator","label":"Author","values":["Chang, Billy Heung Wing"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2014-11"]},{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2015-04-24T17:05:46Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2015-04-24T17:05:46Z"]},{"key":"dc:date.issued","label":"Date","values":["2014-11"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Canonical Correlation Analysis","Dimension Reduction","Kernel Machines","Nonparametric Regression","Variable Importance"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1807/68403"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Kernel-based nonparametric models are often perceived as uninterpretable black boxes. This notion is however questionable; permutation-based variable importance, for example, is one approach for interpreting various nonparametric models. Unfortunately, besides being computationally intensive, permutation-based variable importance is merely a predictor importance measure for supervised regression analysis, and is inapplicable for unsupervised models. This thesis overcomes these issues by using the gradient of kernel-based nonparametric functions to interpret kernel-based models. In particular, the gradient of a kernel regression function can produce variable importance scores with significant computational advantage over permutation-based variable importance. Gradient information can further reveal predictor-response association structure through dimension reduction and graphical analysis; a property not enjoyed by variable importance scores. Most importantly, kernel methods embody a family of supervised and unsupervised learning techniques, and gradient information can be used to interpret not only supervised kernel models, but also unsupervised ones. This fact is demonstrated by using gradient information to interpret the co-dependence structures, as discovered by kernel canonical correlation analysis, between two variable sets."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Ph.D."]},{"key":"dc:title","label":"Title","values":["Kernel Machines are Not Black Boxes - On the Interpretability of Kernel-based Nonparametric Models"]}]}],"canonical_facts":{"dc:contributor.advisor":["Rafal, Kustra"],"dc:contributor.department":["Dalla Lana School of Public Health"],"dc:creator":["Chang, Billy Heung Wing"],"dc:date":["2014-11"],"dc:date.accessioned":["2015-04-24T17:05:46Z"],"dc:date.available":["2015-04-24T17:05:46Z"],"dc:date.issued":["2014-11"],"dc:description.abstract":["Kernel-based nonparametric models are often perceived as uninterpretable black boxes. This notion is however questionable; permutation-based variable importance, for example, is one approach for interpreting various nonparametric models. Unfortunately, besides being computationally intensive, permutation-based variable importance is merely a predictor importance measure for supervised regression analysis, and is inapplicable for unsupervised models. This thesis overcomes these issues by using the gradient of kernel-based nonparametric functions to interpret kernel-based models. In particular, the gradient of a kernel regression function can produce variable importance scores with significant computational advantage over permutation-based variable importance. Gradient information can further reveal predictor-response association structure through dimension reduction and graphical analysis; a property not enjoyed by variable importance scores. Most importantly, kernel methods embody a family of supervised and unsupervised learning techniques, and gradient information can be used to interpret not only supervised kernel models, but also unsupervised ones. This fact is demonstrated by using gradient information to interpret the co-dependence structures, as discovered by kernel canonical correlation analysis, between two variable sets."],"dc:description.degree":["Ph.D."],"dc:identifier.uri":["http://hdl.handle.net/1807/68403"],"dc:subject":["Canonical Correlation Analysis","Dimension Reduction","Kernel Machines","Nonparametric Regression","Variable Importance"],"dc:title":["Kernel Machines are Not Black Boxes - On the Interpretability of Kernel-based Nonparametric Models"],"dc:type":["Thesis"]},"updated_at":"2026-07-27T21:27:52Z"}