{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/16767"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/16767","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Decision-making under statistical uncertainty","abstract":"Statistical decision-making procedures are used in a wide range of contexts varying from communication receiver design to environment monitoring systems. Although such procedures have been studied for a long time, much of the focus has been restricted to systems where the underlying probabilistic model is known accurately. In this thesis we consider the setting where there is some uncertainty about the probabilistic model. We focus on two different problems and present approaches to dealing with statistical uncertainty in each of these cases. For the problem of universal hypothesis testing, we study tests that improve upon the known optimal solution in two different aspects. Firstly, we study the generalized likelihood ratio test (GLRT) that exploits partial knowledge about the alternate distribution to improve finite-sample performance over the Hoeffding test. Although the Hoeffding test is universally optimal in an asymptotic sense, we show that it suffers from high bias and variance which leads to a poor performance over finite observation lengths. The performance degradation of the Hoeffding test is particularly significant for the testing of large alphabet distributions. We also show that the test statistic used in the GLRT is a relaxation of the Kullback-Leibler divergence statistic used in the Hoeffding test. We present results on the asymptotic behavior of the two test statistics to explain the advantage of the GLRT. We then study robust procedures for universal hypothesis testing when there is uncertainty about the null hypothesis. We present new results on the asymptotic behavior of the proposed test statistic which can be used to obtain procedures for setting thresholds in these tests for a target false alarm requirement. We also study the problem of quickest change detection under statistical uncertainty. We formulate a new problem in robust quickest change detection, in which one seeks to minimize the worst-case delay over all possible instances of the uncertain distributions subject to false alarm constraints. We adopt Huber's robust approach and identify sufficient conditions under which change detection procedures designed for certain least-favorable distributions are robust to uncertainties in a minimax sense. These robust tests are simple to implement and give significant performance improvement over some benchmark procedures that are known to be optimal in an asymptotic sense.","abstract_html":"Statistical decision-making procedures are used in a wide range of contexts varying from communication receiver design to environment monitoring systems. Although such procedures have been studied for a long time, much of the focus has been restricted to systems where the underlying probabilistic model is known accurately. In this thesis we consider the setting where there is some uncertainty about the probabilistic model. We focus on two different problems and present approaches to dealing with statistical uncertainty in each of these cases. For the problem of universal hypothesis testing, we study tests that improve upon the known optimal solution in two different aspects. Firstly, we study the generalized likelihood ratio test (GLRT) that exploits partial knowledge about the alternate distribution to improve finite-sample performance over the Hoeffding test. Although the Hoeffding test is universally optimal in an asymptotic sense, we show that it suffers from high bias and variance which leads to a poor performance over finite observation lengths. The performance degradation of the Hoeffding test is particularly significant for the testing of large alphabet distributions. We also show that the test statistic used in the GLRT is a relaxation of the Kullback-Leibler divergence statistic used in the Hoeffding test. We present results on the asymptotic behavior of the two test statistics to explain the advantage of the GLRT. We then study robust procedures for universal hypothesis testing when there is uncertainty about the null hypothesis. We present new results on the asymptotic behavior of the proposed test statistic which can be used to obtain procedures for setting thresholds in these tests for a target false alarm requirement. We also study the problem of quickest change detection under statistical uncertainty. We formulate a new problem in robust quickest change detection, in which one seeks to minimize the worst-case delay over all possible instances of the uncertain distributions subject to false alarm constraints. We adopt Huber's robust approach and identify sufficient conditions under which change detection procedures designed for certain least-favorable distributions are robust to uncertainties in a minimax sense. These robust tests are simple to implement and give significant performance improvement over some benchmark procedures that are known to be optimal in an asymptotic sense.","abstract_has_math":false,"creators":["Unnikrishnan, Jayakrishnan"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Meyn, Sean P.","Veeravalli, Venugopal V.","Hajek, Bruce","Viswanath, Pramod"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2010,"date_issued":"2010-08-20T17:57:16Z","date_published":"2010-08-20T17:57:16Z","updated_at":"2026-07-22T22:25:09Z","subjects":["hypothesis testing","robust statistics","quickest change detection"],"languages":["en"],"rights":["Copyright 2010 Jayakrishnan Unnikrishnan"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/16767","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Meyn, Sean P.","Veeravalli, Venugopal V.","Hajek, Bruce","Viswanath, Pramod"]},{"key":"dc:creator","label":"Author","values":["Unnikrishnan, Jayakrishnan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2010-08-20T17:57:16Z","2010-08"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["hypothesis testing","robust statistics","quickest change detection"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2010 Jayakrishnan Unnikrishnan"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/16767"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Statistical decision-making procedures are used in a wide range of contexts varying from communication receiver design to environment monitoring systems. Although such procedures have been studied for a long time, much of the focus has been restricted to systems where the underlying probabilistic model is known accurately. In this thesis we consider the setting where there is some uncertainty about the probabilistic model. We focus on two different problems and present approaches to dealing with statistical uncertainty in each of these cases. For the problem of universal hypothesis testing, we study tests that improve upon the known optimal solution in two different aspects. Firstly, we study the generalized likelihood ratio test (GLRT) that exploits partial knowledge about the alternate distribution to improve finite-sample performance over the Hoeffding test. Although the Hoeffding test is universally optimal in an asymptotic sense, we show that it suffers from high bias and variance which leads to a poor performance over finite observation lengths. The performance degradation of the Hoeffding test is particularly significant for the testing of large alphabet distributions. We also show that the test statistic used in the GLRT is a relaxation of the Kullback-Leibler divergence statistic used in the Hoeffding test. We present results on the asymptotic behavior of the two test statistics to explain the advantage of the GLRT. We then study robust procedures for universal hypothesis testing when there is uncertainty about the null hypothesis. We present new results on the asymptotic behavior of the proposed test statistic which can be used to obtain procedures for setting thresholds in these tests for a target false alarm requirement. We also study the problem of quickest change detection under statistical uncertainty. We formulate a new problem in robust quickest change detection, in which one seeks to minimize the worst-case delay over all possible instances of the uncertain distributions subject to false alarm constraints. We adopt Huber's robust approach and identify sufficient conditions under which change detection procedures designed for certain least-favorable distributions are robust to uncertainties in a minimax sense. These robust tests are simple to implement and give significant performance improvement over some benchmark procedures that are known to be optimal in an asymptotic sense.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2010-07-14T19:09:44Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 3 Unnikrishnan_Jayakrishnan.zip: 2448677 bytes, checksum: 5631e4ef52738340f514762d335522f5 (MD5) ecedissertation.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5) Unnikrishnan_Jayakrishnan.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5)","Made available in DSpace on 2010-08-20T17:57:16Z (GMT). No. of bitstreams: 4 Unnikrishnan_Jayakrishnan.zip: 2448677 bytes, checksum: 5631e4ef52738340f514762d335522f5 (MD5) ecedissertation.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5) Unnikrishnan_Jayakrishnan.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5) license.txt: 4075 bytes, checksum: f8c68a12a5dc85b22bfd344182ccd28b (MD5)"]},{"key":"dc:title","label":"Title","values":["Decision-making under statistical uncertainty"]}]}],"canonical_facts":{"dc:contributor":["Meyn, Sean P.","Veeravalli, Venugopal V.","Hajek, Bruce","Viswanath, Pramod"],"dc:creator":["Unnikrishnan, Jayakrishnan"],"dc:date":["2010-08-20T17:57:16Z","2010-08"],"dc:description":["Statistical decision-making procedures are used in a wide range of contexts varying from communication receiver design to environment monitoring systems. Although such procedures have been studied for a long time, much of the focus has been restricted to systems where the underlying probabilistic model is known accurately. In this thesis we consider the setting where there is some uncertainty about the probabilistic model. We focus on two different problems and present approaches to dealing with statistical uncertainty in each of these cases. For the problem of universal hypothesis testing, we study tests that improve upon the known optimal solution in two different aspects. Firstly, we study the generalized likelihood ratio test (GLRT) that exploits partial knowledge about the alternate distribution to improve finite-sample performance over the Hoeffding test. Although the Hoeffding test is universally optimal in an asymptotic sense, we show that it suffers from high bias and variance which leads to a poor performance over finite observation lengths. The performance degradation of the Hoeffding test is particularly significant for the testing of large alphabet distributions. We also show that the test statistic used in the GLRT is a relaxation of the Kullback-Leibler divergence statistic used in the Hoeffding test. We present results on the asymptotic behavior of the two test statistics to explain the advantage of the GLRT. We then study robust procedures for universal hypothesis testing when there is uncertainty about the null hypothesis. We present new results on the asymptotic behavior of the proposed test statistic which can be used to obtain procedures for setting thresholds in these tests for a target false alarm requirement. We also study the problem of quickest change detection under statistical uncertainty. We formulate a new problem in robust quickest change detection, in which one seeks to minimize the worst-case delay over all possible instances of the uncertain distributions subject to false alarm constraints. We adopt Huber's robust approach and identify sufficient conditions under which change detection procedures designed for certain least-favorable distributions are robust to uncertainties in a minimax sense. These robust tests are simple to implement and give significant performance improvement over some benchmark procedures that are known to be optimal in an asymptotic sense.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2010-07-14T19:09:44Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 3 Unnikrishnan_Jayakrishnan.zip: 2448677 bytes, checksum: 5631e4ef52738340f514762d335522f5 (MD5) ecedissertation.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5) Unnikrishnan_Jayakrishnan.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5)","Made available in DSpace on 2010-08-20T17:57:16Z (GMT). No. of bitstreams: 4 Unnikrishnan_Jayakrishnan.zip: 2448677 bytes, checksum: 5631e4ef52738340f514762d335522f5 (MD5) ecedissertation.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5) Unnikrishnan_Jayakrishnan.pdf: 723655 bytes, checksum: 7a32f5cdfc5c2d4640dcee8b5c7a999b (MD5) license.txt: 4075 bytes, checksum: f8c68a12a5dc85b22bfd344182ccd28b (MD5)"],"dc:identifier":["http://hdl.handle.net/2142/16767"],"dc:language":["en"],"dc:rights":["Copyright 2010 Jayakrishnan Unnikrishnan"],"dc:subject":["hypothesis testing","robust statistics","quickest change detection"],"dc:title":["Decision-making under statistical uncertainty"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:09Z"}