{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/22737"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/22737","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Maintaining the utility of learned knowledge using model-based adaptive control","abstract":"The overfit problem in empirical learning and the utility problem in analytical learning both describe a common behavior of machine learning methods: the eventual degradation of performance due to increasing amounts of learned knowledge. Plotting the performance of the changing knowledge during execution of a machine learning method (the performance response) reveals similar curves for several methods. The performance response generally indicates a single peak performance greater than that attained by popular pruning techniques. The similarity in performance responses suggests a parameterized model relating performance to the amount of learned knowledge. Given this model, a model-based adaptive control (MBAC) approach can be used to update the model based on feedback from the performance element and make control decisions regarding the amount of knowledge to be learned or unlearned.","abstract_html":"The overfit problem in empirical learning and the utility problem in analytical learning both describe a common behavior of machine learning methods: the eventual degradation of performance due to increasing amounts of learned knowledge. Plotting the performance of the changing knowledge during execution of a machine learning method (the performance response) reveals similar curves for several methods. The performance response generally indicates a single peak performance greater than that attained by popular pruning techniques. The similarity in performance responses suggests a parameterized model relating performance to the amount of learned knowledge. Given this model, a model-based adaptive control (MBAC) approach can be used to update the model based on feedback from the performance element and make control decisions regarding the amount of knowledge to be learned or unlearned.","abstract_has_math":false,"creators":["Holder, Lawrence B."],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Rendell, Larry A."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2011,"date_issued":"2011-05-07T13:49:47Z","date_published":"2011-05-07T13:49:47Z","updated_at":"2026-07-22T22:25:20Z","subjects":["Artificial Intelligence","Computer Science"],"languages":["eng"],"rights":["Copyright 1991 Holder, Lawrence Bruce, Jr"],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9210839","(UMI)AAI9210839"],"render_values":[{"text":"AAI9210839","href":null,"code":true},{"text":"(UMI)AAI9210839","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/2142/22737","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Rendell, Larry A."]},{"key":"dc:creator","label":"Author","values":["Holder, Lawrence B."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2011-05-07T13:49:47Z","10000-01-01","1991"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Artificial Intelligence","Computer Science"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 1991 Holder, Lawrence Bruce, Jr"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9210839","(UMI)AAI9210839","http://hdl.handle.net/2142/22737"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The overfit problem in empirical learning and the utility problem in analytical learning both describe a common behavior of machine learning methods: the eventual degradation of performance due to increasing amounts of learned knowledge. Plotting the performance of the changing knowledge during execution of a machine learning method (the performance response) reveals similar curves for several methods. The performance response generally indicates a single peak performance greater than that attained by popular pruning techniques. The similarity in performance responses suggests a parameterized model relating performance to the amount of learned knowledge. Given this model, a model-based adaptive control (MBAC) approach can be used to update the model based on feedback from the performance element and make control decisions regarding the amount of knowledge to be learned or unlearned.","In view of the large number of alternative learning methods, a more general utility problem exists in determining not only the correct amount of learned knowledge, but also the correct method for learning this knowledge. Relying too heavily on one particular learning method may result in less than optimal performance achievement. Overcoming this general utility problem requires a new control mechanism for determining the correct learning method and amount of learned knowledge in order to achieve the performance objectives of the task. Maintaining models for several learning methods allows the MBAC approach to decide the appropriate type of learning, in addition to the amount.","Experimentation analyzes the ability of the MBAC approach to converge upon the peak of the performance response and avoid generation of low utility knowledge. Results indicate that a quadratic model is sufficient to fit the peak of the performance response and that MBAC using the quadratic model performs well at selecting the best learning method for a given learning task. More formal analysis of the performance response supports the quadratic model for controlling how much knowledge to learn as opposed to which knowledge.","Made available in DSpace on 2011-05-07T13:49:47Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9210839.pdf: 6781078 bytes, checksum: 2b601adeb9ba020fa5fd7a63c8890d11 (MD5) Previous issue date: 1991","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T14:59:39Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:28:10-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"]},{"key":"dc:title","label":"Title","values":["Maintaining the utility of learned knowledge using model-based adaptive control"]}]}],"canonical_facts":{"dc:contributor":["Rendell, Larry A."],"dc:creator":["Holder, Lawrence B."],"dc:date":["2011-05-07T13:49:47Z","10000-01-01","1991"],"dc:description":["The overfit problem in empirical learning and the utility problem in analytical learning both describe a common behavior of machine learning methods: the eventual degradation of performance due to increasing amounts of learned knowledge. Plotting the performance of the changing knowledge during execution of a machine learning method (the performance response) reveals similar curves for several methods. The performance response generally indicates a single peak performance greater than that attained by popular pruning techniques. The similarity in performance responses suggests a parameterized model relating performance to the amount of learned knowledge. Given this model, a model-based adaptive control (MBAC) approach can be used to update the model based on feedback from the performance element and make control decisions regarding the amount of knowledge to be learned or unlearned.","In view of the large number of alternative learning methods, a more general utility problem exists in determining not only the correct amount of learned knowledge, but also the correct method for learning this knowledge. Relying too heavily on one particular learning method may result in less than optimal performance achievement. Overcoming this general utility problem requires a new control mechanism for determining the correct learning method and amount of learned knowledge in order to achieve the performance objectives of the task. Maintaining models for several learning methods allows the MBAC approach to decide the appropriate type of learning, in addition to the amount.","Experimentation analyzes the ability of the MBAC approach to converge upon the peak of the performance response and avoid generation of low utility knowledge. Results indicate that a quadratic model is sufficient to fit the peak of the performance response and that MBAC using the quadratic model performs well at selecting the best learning method for a given learning task. More formal analysis of the performance response supports the quadratic model for controlling how much knowledge to learn as opposed to which knowledge.","Made available in DSpace on 2011-05-07T13:49:47Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9210839.pdf: 6781078 bytes, checksum: 2b601adeb9ba020fa5fd7a63c8890d11 (MD5) Previous issue date: 1991","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T14:59:39Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:28:10-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"],"dc:identifier":["AAI9210839","(UMI)AAI9210839","http://hdl.handle.net/2142/22737"],"dc:language":["eng"],"dc:rights":["Copyright 1991 Holder, Lawrence Bruce, Jr"],"dc:subject":["Artificial Intelligence","Computer Science"],"dc:title":["Maintaining the utility of learned knowledge using model-based adaptive control"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:20Z"}