{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/50628"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/50628","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Inertial iterative thresholding with applications to sparse and low-rank signal recovery","abstract":"This thesis is concerned with a class of methods known collectively as iterative thresholding algorithms. These methods have been used by researchers for several decades to solve various optimization problems that arise in signal processing, inverse problems, pattern recognition and other related fields. One such problem of great interest is compressed sensing, where the goal is to recover a signal that is known to be sparse from fewer linear measurements than the dimension of the signal. Another is low-rank matrix completion where one wants to recover a low-rank matrix from a subset of revealed entries. A third example is robust principle component analysis (RPCA) where one is given a data matrix and would like to decompose it into a low-rank component and a sparse component. Other examples include total variation denoising and deblurring, and L`1-regularized regression. Iterative thresholding methods have low complexity, but they typically take many iterations to converge, especially on ill-conditioned problems. In this thesis we explore how inertia can be used to accelerate iterative thresholding algorithms. A second problem with iterative thresholding algorithms is they tend to become trapped in undesirable local minima when the problem is non-convex. We discuss how inertia can help iterative thresholding methods to avoid local minima and propose several schemes to solve well-known non-convex problems.","abstract_html":"This thesis is concerned with a class of methods known collectively as iterative thresholding algorithms. These methods have been used by researchers for several decades to solve various optimization problems that arise in signal processing, inverse problems, pattern recognition and other related fields. One such problem of great interest is compressed sensing, where the goal is to recover a signal that is known to be sparse from fewer linear measurements than the dimension of the signal. Another is low-rank matrix completion where one wants to recover a low-rank matrix from a subset of revealed entries. A third example is robust principle component analysis (RPCA) where one is given a data matrix and would like to decompose it into a low-rank component and a sparse component. Other examples include total variation denoising and deblurring, and L`1-regularized regression. Iterative thresholding methods have low complexity, but they typically take many iterations to converge, especially on ill-conditioned problems. In this thesis we explore how inertia can be used to accelerate iterative thresholding algorithms. A second problem with iterative thresholding algorithms is they tend to become trapped in undesirable local minima when the problem is non-convex. We discuss how inertia can help iterative thresholding methods to avoid local minima and propose several schemes to solve well-known non-convex problems.","abstract_has_math":false,"creators":["Johnstone, Patrick"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Moulin, Pierre"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2014,"date_issued":"2014-09-16T17:24:31Z","date_published":"2014-09-16T17:24:31Z","updated_at":"2026-07-22T22:25:40Z","subjects":["Iterative shrinkage and thresholding","gradient descent with momentum","the heavy-ball method","the conjugate gradient method"],"languages":["en"],"rights":["2014 Patrick Royce Johnstone"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/50628","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Moulin, Pierre"]},{"key":"dc:creator","label":"Author","values":["Johnstone, Patrick"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2014-09-16T17:24:31Z","2014-08","2014-09-16"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Iterative shrinkage and thresholding","gradient descent with momentum","the heavy-ball method","the conjugate gradient method"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["2014 Patrick Royce Johnstone"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/50628"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This thesis is concerned with a class of methods known collectively as iterative thresholding algorithms. These methods have been used by researchers for several decades to solve various optimization problems that arise in signal processing, inverse problems, pattern recognition and other related fields. One such problem of great interest is compressed sensing, where the goal is to recover a signal that is known to be sparse from fewer linear measurements than the dimension of the signal. Another is low-rank matrix completion where one wants to recover a low-rank matrix from a subset of revealed entries. A third example is robust principle component analysis (RPCA) where one is given a data matrix and would like to decompose it into a low-rank component and a sparse component. Other examples include total variation denoising and deblurring, and L`1-regularized regression. Iterative thresholding methods have low complexity, but they typically take many iterations to converge, especially on ill-conditioned problems. In this thesis we explore how inertia can be used to accelerate iterative thresholding algorithms. A second problem with iterative thresholding algorithms is they tend to become trapped in undesirable local minima when the problem is non-convex. We discuss how inertia can help iterative thresholding methods to avoid local minima and propose several schemes to solve well-known non-convex problems.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2014-07-18T20:16:22Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Johnstone_Patrick.pdf: 455974 bytes, checksum: 867544a79b251a823d525364201f6409 (MD5)","Made available in DSpace on 2014-09-16T17:24:31Z (GMT). No. of bitstreams: 2 Patrick_Johnstone.pdf: 455974 bytes, checksum: 867544a79b251a823d525364201f6409 (MD5) license.txt: 4067 bytes, checksum: 3fe5774af723481022579fc9b5d37a44 (MD5)"]},{"key":"dc:title","label":"Title","values":["Inertial iterative thresholding with applications to sparse and low-rank signal recovery"]}]}],"canonical_facts":{"dc:contributor":["Moulin, Pierre"],"dc:creator":["Johnstone, Patrick"],"dc:date":["2014-09-16T17:24:31Z","2014-08","2014-09-16"],"dc:description":["This thesis is concerned with a class of methods known collectively as iterative thresholding algorithms. These methods have been used by researchers for several decades to solve various optimization problems that arise in signal processing, inverse problems, pattern recognition and other related fields. One such problem of great interest is compressed sensing, where the goal is to recover a signal that is known to be sparse from fewer linear measurements than the dimension of the signal. Another is low-rank matrix completion where one wants to recover a low-rank matrix from a subset of revealed entries. A third example is robust principle component analysis (RPCA) where one is given a data matrix and would like to decompose it into a low-rank component and a sparse component. Other examples include total variation denoising and deblurring, and L`1-regularized regression. Iterative thresholding methods have low complexity, but they typically take many iterations to converge, especially on ill-conditioned problems. In this thesis we explore how inertia can be used to accelerate iterative thresholding algorithms. A second problem with iterative thresholding algorithms is they tend to become trapped in undesirable local minima when the problem is non-convex. We discuss how inertia can help iterative thresholding methods to avoid local minima and propose several schemes to solve well-known non-convex problems.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2014-07-18T20:16:22Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Johnstone_Patrick.pdf: 455974 bytes, checksum: 867544a79b251a823d525364201f6409 (MD5)","Made available in DSpace on 2014-09-16T17:24:31Z (GMT). No. of bitstreams: 2 Patrick_Johnstone.pdf: 455974 bytes, checksum: 867544a79b251a823d525364201f6409 (MD5) license.txt: 4067 bytes, checksum: 3fe5774af723481022579fc9b5d37a44 (MD5)"],"dc:identifier":["http://hdl.handle.net/2142/50628"],"dc:language":["en"],"dc:rights":["2014 Patrick Royce Johnstone"],"dc:subject":["Iterative shrinkage and thresholding","gradient descent with momentum","the heavy-ball method","the conjugate gradient method"],"dc:title":["Inertial iterative thresholding with applications to sparse and low-rank signal recovery"],"dc:type":["text"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:40Z"}