{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/34532"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/34532","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Fast superresolution based on a network structure trained using sparse coding","abstract":"In this thesis I present a novel approach to superresolution using a network structure. Sparse representation of image signals forms the cornerstone of our approach and the goal is to obtain resolution enhancement of the low resolution images. I will discuss various dictionary learning methods and also a joint dictionary training approach. Superresolution is used to enhance the resolution of low quality and low resolution images from electronic devices such as surveillance cameras, which have limitations on the number of sensors they can accommodate. Many medical diagnostic devices and military applications demand increased image resolution for a better and a more detailed analysis and a deeper understanding of the minute and subtle details. These details are rendered incomprehensible in their original low resolution form. Sparse coding is a technique of finding an optimal sparse code vector corresponding to an input vector. This sparse representation minimizes the error energy function that includes the square of the L2 norm and a regularization term containing the L1 norm of the sparse vector. This sets up a regularized least squares solution. The L1 norm is preferred because it promotes the sparseness of the solution. The L0 norm term in the regularization parameter may result in the solution being obtained in a combinatorial manner, and that may result in finding the solution of the problem to be NP-hard. The regularization term can have an L2 norm, which is called the Tikhonov regularization. The Learning of the Iterative Shrinkage and Thresholding Algorithm (ISTA) is achieved by learning a regression function which accepts a test signal vector as the input and provides a corresponding sparse vector as an output for that signal. The testing part is based on the forward-propagation which is similar to the ISTA network structure. The learning part of the network encoder is however based on a back-propagation model and uses the stochastic-gradient descent method. The error function is the difference between the sparse representations obtained from either ISTA, the Basis Pursuit, or any other L1 regularization solver such as LASSO or LARS, and the regression function obtained by training on the sparse vector obtained from the sparse recovery algorithm. The error function is minimized with respect to the three network parameters. We learn regression function parameters such that the error difference between the regression function and the sparse coding solution vector obtained from the optimization solver is minimized. The sparse representation can also be originally obtained from any convenient L1 regularization solver. Once the regression function is learned, the high resolution patches are simply the product of the high resolution dictionary and the sparse solution obtained from the trained regression function. The low resolution and high resolution dictionaries are usually trained jointly so the sparse coded solution is the same for both the low resolution and high resolution image patches. Our approach increases the computational speed and tries to decrease its cost as, having learned the regression function, we try to bypass the optimization problem.","abstract_html":"In this thesis I present a novel approach to superresolution using a network structure. Sparse representation of image signals forms the cornerstone of our approach and the goal is to obtain resolution enhancement of the low resolution images. I will discuss various dictionary learning methods and also a joint dictionary training approach. Superresolution is used to enhance the resolution of low quality and low resolution images from electronic devices such as surveillance cameras, which have limitations on the number of sensors they can accommodate. Many medical diagnostic devices and military applications demand increased image resolution for a better and a more detailed analysis and a deeper understanding of the minute and subtle details. These details are rendered incomprehensible in their original low resolution form. Sparse coding is a technique of finding an optimal sparse code vector corresponding to an input vector. This sparse representation minimizes the error energy function that includes the square of the L2 norm and a regularization term containing the L1 norm of the sparse vector. This sets up a regularized least squares solution. The L1 norm is preferred because it promotes the sparseness of the solution. The L0 norm term in the regularization parameter may result in the solution being obtained in a combinatorial manner, and that may result in finding the solution of the problem to be NP-hard. The regularization term can have an L2 norm, which is called the Tikhonov regularization. The Learning of the Iterative Shrinkage and Thresholding Algorithm (ISTA) is achieved by learning a regression function which accepts a test signal vector as the input and provides a corresponding sparse vector as an output for that signal. The testing part is based on the forward-propagation which is similar to the ISTA network structure. The learning part of the network encoder is however based on a back-propagation model and uses the stochastic-gradient descent method. The error function is the difference between the sparse representations obtained from either ISTA, the Basis Pursuit, or any other L1 regularization solver such as LASSO or LARS, and the regression function obtained by training on the sparse vector obtained from the sparse recovery algorithm. The error function is minimized with respect to the three network parameters. We learn regression function parameters such that the error difference between the regression function and the sparse coding solution vector obtained from the optimization solver is minimized. The sparse representation can also be originally obtained from any convenient L1 regularization solver. Once the regression function is learned, the high resolution patches are simply the product of the high resolution dictionary and the sparse solution obtained from the trained regression function. The low resolution and high resolution dictionaries are usually trained jointly so the sparse coded solution is the same for both the low resolution and high resolution image patches. Our approach increases the computational speed and tries to decrease its cost as, having learned the regression function, we try to bypass the optimization problem.","abstract_has_math":false,"creators":["Ghauri, Ahsan"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Huang, Thomas S."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2012,"date_issued":"2012-09-18T21:24:23Z","date_published":"2012-09-18T21:24:23Z","updated_at":"2026-07-22T22:25:31Z","subjects":["Superresolution","sparse representation","regularization","optimization and dictionary"],"languages":["en"],"rights":["Copyright 2012 Ahsan Ghauri"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/34532","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Huang, Thomas S."]},{"key":"dc:creator","label":"Author","values":["Ghauri, Ahsan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2012-09-18T21:24:23Z","2014-09-18T10:00:56Z","2017-02-23T10:15:20Z","2019-04-04T09:15:31Z","2022-03-26T09:15:19Z","2012-08"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Superresolution","sparse representation","regularization","optimization and dictionary"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2012 Ahsan Ghauri"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/34532"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In this thesis I present a novel approach to superresolution using a network structure. Sparse representation of image signals forms the cornerstone of our approach and the goal is to obtain resolution enhancement of the low resolution images. I will discuss various dictionary learning methods and also a joint dictionary training approach. Superresolution is used to enhance the resolution of low quality and low resolution images from electronic devices such as surveillance cameras, which have limitations on the number of sensors they can accommodate. Many medical diagnostic devices and military applications demand increased image resolution for a better and a more detailed analysis and a deeper understanding of the minute and subtle details. These details are rendered incomprehensible in their original low resolution form. Sparse coding is a technique of finding an optimal sparse code vector corresponding to an input vector. This sparse representation minimizes the error energy function that includes the square of the L2 norm and a regularization term containing the L1 norm of the sparse vector. This sets up a regularized least squares solution. The L1 norm is preferred because it promotes the sparseness of the solution. The L0 norm term in the regularization parameter may result in the solution being obtained in a combinatorial manner, and that may result in finding the solution of the problem to be NP-hard. The regularization term can have an L2 norm, which is called the Tikhonov regularization. The Learning of the Iterative Shrinkage and Thresholding Algorithm (ISTA) is achieved by learning a regression function which accepts a test signal vector as the input and provides a corresponding sparse vector as an output for that signal. The testing part is based on the forward-propagation which is similar to the ISTA network structure. The learning part of the network encoder is however based on a back-propagation model and uses the stochastic-gradient descent method. The error function is the difference between the sparse representations obtained from either ISTA, the Basis Pursuit, or any other L1 regularization solver such as LASSO or LARS, and the regression function obtained by training on the sparse vector obtained from the sparse recovery algorithm. The error function is minimized with respect to the three network parameters. We learn regression function parameters such that the error difference between the regression function and the sparse coding solution vector obtained from the optimization solver is minimized. The sparse representation can also be originally obtained from any convenient L1 regularization solver. Once the regression function is learned, the high resolution patches are simply the product of the high resolution dictionary and the sparse solution obtained from the trained regression function. The low resolution and high resolution dictionaries are usually trained jointly so the sparse coded solution is the same for both the low resolution and high resolution image patches. Our approach increases the computational speed and tries to decrease its cost as, having learned the regression function, we try to bypass the optimization problem.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-07-20T17:42:49Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 ghauri_ahsan.pdf: 1141273 bytes, checksum: 490665fa61cca8f49f52297941657019 (MD5)","Made available in DSpace on 2012-09-18T21:24:23Z (GMT). No. of bitstreams: 2 ghauri_ahsan.pdf: 1104875 bytes, checksum: ebe404dd501549cc46cb05daf6c47ca3 (MD5) license.txt: 4061 bytes, checksum: 4934004cca77cacb929e834a8225c97c (MD5)","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (srobbins@illinois.edu) on 2012-09-18T21:27:22Z Item is restricted until 2014-09-18T21:27:16Z","Restriction data tranferred 2014-07-01T11:35:44-05:00 Original Data Group with Access Administrator Release Date: 2014-09-18 16:27:16 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 34806 on 2014-09-18T10:00:56Z.","Limited Restriction Lifted for Item 34806 on 2017-02-23T10:15:20Z.","U of I Only Restriction set for Item 34806 on 2017-04-04T14:57:13Z with date 2019-04-04 by kappleg2@illinois.edu.","U of I Only Restriction set for Item 34806 on 2017-04-04T14:57:20Z with date 2019-04-04 by kappleg2@illinois.edu.","U of I Only Restriction Lifted for Item 34806 on 2019-04-04T09:15:31Z.","U of I Only Restriction set for Item 34806 on 2020-03-26T15:37:12Z with date 2022-03-26 by fschaef2@illinois.edu.","U of I Only Restriction set for Item 34806 on 2020-03-26T15:37:14Z with date 2022-03-26 by fschaef2@illinois.edu.","U of I Only Restriction Lifted for Item 34806 on 2022-03-26T09:15:19Z."]},{"key":"dc:title","label":"Title","values":["Fast superresolution based on a network structure trained using sparse coding"]}]}],"canonical_facts":{"dc:contributor":["Huang, Thomas S."],"dc:creator":["Ghauri, Ahsan"],"dc:date":["2012-09-18T21:24:23Z","2014-09-18T10:00:56Z","2017-02-23T10:15:20Z","2019-04-04T09:15:31Z","2022-03-26T09:15:19Z","2012-08"],"dc:description":["In this thesis I present a novel approach to superresolution using a network structure. Sparse representation of image signals forms the cornerstone of our approach and the goal is to obtain resolution enhancement of the low resolution images. I will discuss various dictionary learning methods and also a joint dictionary training approach. Superresolution is used to enhance the resolution of low quality and low resolution images from electronic devices such as surveillance cameras, which have limitations on the number of sensors they can accommodate. Many medical diagnostic devices and military applications demand increased image resolution for a better and a more detailed analysis and a deeper understanding of the minute and subtle details. These details are rendered incomprehensible in their original low resolution form. Sparse coding is a technique of finding an optimal sparse code vector corresponding to an input vector. This sparse representation minimizes the error energy function that includes the square of the L2 norm and a regularization term containing the L1 norm of the sparse vector. This sets up a regularized least squares solution. The L1 norm is preferred because it promotes the sparseness of the solution. The L0 norm term in the regularization parameter may result in the solution being obtained in a combinatorial manner, and that may result in finding the solution of the problem to be NP-hard. The regularization term can have an L2 norm, which is called the Tikhonov regularization. The Learning of the Iterative Shrinkage and Thresholding Algorithm (ISTA) is achieved by learning a regression function which accepts a test signal vector as the input and provides a corresponding sparse vector as an output for that signal. The testing part is based on the forward-propagation which is similar to the ISTA network structure. The learning part of the network encoder is however based on a back-propagation model and uses the stochastic-gradient descent method. The error function is the difference between the sparse representations obtained from either ISTA, the Basis Pursuit, or any other L1 regularization solver such as LASSO or LARS, and the regression function obtained by training on the sparse vector obtained from the sparse recovery algorithm. The error function is minimized with respect to the three network parameters. We learn regression function parameters such that the error difference between the regression function and the sparse coding solution vector obtained from the optimization solver is minimized. The sparse representation can also be originally obtained from any convenient L1 regularization solver. Once the regression function is learned, the high resolution patches are simply the product of the high resolution dictionary and the sparse solution obtained from the trained regression function. The low resolution and high resolution dictionaries are usually trained jointly so the sparse coded solution is the same for both the low resolution and high resolution image patches. Our approach increases the computational speed and tries to decrease its cost as, having learned the regression function, we try to bypass the optimization problem.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-07-20T17:42:49Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 ghauri_ahsan.pdf: 1141273 bytes, checksum: 490665fa61cca8f49f52297941657019 (MD5)","Made available in DSpace on 2012-09-18T21:24:23Z (GMT). No. of bitstreams: 2 ghauri_ahsan.pdf: 1104875 bytes, checksum: ebe404dd501549cc46cb05daf6c47ca3 (MD5) license.txt: 4061 bytes, checksum: 4934004cca77cacb929e834a8225c97c (MD5)","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (srobbins@illinois.edu) on 2012-09-18T21:27:22Z Item is restricted until 2014-09-18T21:27:16Z","Restriction data tranferred 2014-07-01T11:35:44-05:00 Original Data Group with Access Administrator Release Date: 2014-09-18 16:27:16 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 34806 on 2014-09-18T10:00:56Z.","Limited Restriction Lifted for Item 34806 on 2017-02-23T10:15:20Z.","U of I Only Restriction set for Item 34806 on 2017-04-04T14:57:13Z with date 2019-04-04 by kappleg2@illinois.edu.","U of I Only Restriction set for Item 34806 on 2017-04-04T14:57:20Z with date 2019-04-04 by kappleg2@illinois.edu.","U of I Only Restriction Lifted for Item 34806 on 2019-04-04T09:15:31Z.","U of I Only Restriction set for Item 34806 on 2020-03-26T15:37:12Z with date 2022-03-26 by fschaef2@illinois.edu.","U of I Only Restriction set for Item 34806 on 2020-03-26T15:37:14Z with date 2022-03-26 by fschaef2@illinois.edu.","U of I Only Restriction Lifted for Item 34806 on 2022-03-26T09:15:19Z."],"dc:identifier":["http://hdl.handle.net/2142/34532"],"dc:language":["en"],"dc:rights":["Copyright 2012 Ahsan Ghauri"],"dc:subject":["Superresolution","sparse representation","regularization","optimization and dictionary"],"dc:title":["Fast superresolution based on a network structure trained using sparse coding"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:31Z"}