{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/98199"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/98199","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Learning sparse features and metric in signal and image processing","abstract":"This dissertation studies two aspects of feature learning: representation learning and metric in feature space, from a machine learning perspective. Feature learning is a fundamental problem in computer vision and machine learning. First introduced in computational neuroscience in the context of sparse coding in the visual system, sparse coding plays a key role in feature representation learning, as the over-complete dictionary allows more representation flexibility and efficiency, and captures structures and patterns inherent in the raw data. First, we explore sparse representation and propose a novel sparse matrix factorization method for learning a dictionary in both a reconstructive and discriminative manner. The obtained representations can be directly used for multi-class classification. We also apply sparse representation on a camera trap dataset for wildlife monitoring and demonstrate good performance of sparse features in a challenging real world scenario. Second, from a theoretical perspective, we show that the popular ℓ1-norm based methods break down in the presence of high coherence and large noise. We introduce a novel regularization approach to handle model collinearity and obtain parsimonious variable selection simultaneously. The regularization term is non-convex and can take into account structured sparsity (e.g., group sparsity). We propose an efficient iterative thresholding procedure for solving the optimization. Our method achieves state-of-the-art performance for super-resolution signal spectrum estimation. On the other hand, in order to enhance the discriminative power of learned features, supervised learning is crucial. A proper metric is desired for various problems, such as image retrieval, similarity learning and face verification. We propose a ranking based metric learning algorithm under maximum margin criterion. We propose both batch and online algorithms. The regret bounds are given for online algorithms. Experiments are conducted on 3D human body shape matching problem and state-of-the-art performance is achieved.","abstract_html":"This dissertation studies two aspects of feature learning: representation learning and metric in feature space, from a machine learning perspective. Feature learning is a fundamental problem in computer vision and machine learning. First introduced in computational neuroscience in the context of sparse coding in the visual system, sparse coding plays a key role in feature representation learning, as the over-complete dictionary allows more representation flexibility and efficiency, and captures structures and patterns inherent in the raw data. First, we explore sparse representation and propose a novel sparse matrix factorization method for learning a dictionary in both a reconstructive and discriminative manner. The obtained representations can be directly used for multi-class classification. We also apply sparse representation on a camera trap dataset for wildlife monitoring and demonstrate good performance of sparse features in a challenging real world scenario. Second, from a theoretical perspective, we show that the popular ℓ1-norm based methods break down in the presence of high coherence and large noise. We introduce a novel regularization approach to handle model collinearity and obtain parsimonious variable selection simultaneously. The regularization term is non-convex and can take into account structured sparsity (e.g., group sparsity). We propose an efficient iterative thresholding procedure for solving the optimization. Our method achieves state-of-the-art performance for super-resolution signal spectrum estimation. On the other hand, in order to enhance the discriminative power of learned features, supervised learning is crucial. A proper metric is desired for various problems, such as image retrieval, similarity learning and face verification. We propose a ranking based metric learning algorithm under maximum margin criterion. We propose both batch and online algorithms. The regret bounds are given for online algorithms. Experiments are conducted on 3D human body shape matching problem and state-of-the-art performance is achieved.","abstract_has_math":false,"creators":["Wang, Jiangping"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Huang, Thomas","Hasegawa-Johnson, Mark","Liang, Zhi-Pei","Liang, Feng"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2017,"date_issued":"2017-09-29T17:45:21Z","date_published":"2017-09-29T17:45:21Z","updated_at":"2026-07-22T22:24:35Z","subjects":["Feature learning","Sparse coding","Metric learning","Dictionary learning","Spectral analysis","Image classification","Wildlife monitoring","Shape matching"],"languages":["en"],"rights":["Copyright 2017 Jiangping Wang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/98199","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Huang, Thomas","Hasegawa-Johnson, Mark","Liang, Zhi-Pei","Liang, Feng"]},{"key":"dc:creator","label":"Author","values":["Wang, Jiangping"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2017-09-29T17:45:21Z","2020-03-03T10:15:32Z","2017-07-06","2017-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Feature learning","Sparse coding","Metric learning","Dictionary learning","Spectral analysis","Image classification","Wildlife monitoring","Shape matching"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2017 Jiangping Wang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/98199"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This dissertation studies two aspects of feature learning: representation learning and metric in feature space, from a machine learning perspective. Feature learning is a fundamental problem in computer vision and machine learning. First introduced in computational neuroscience in the context of sparse coding in the visual system, sparse coding plays a key role in feature representation learning, as the over-complete dictionary allows more representation flexibility and efficiency, and captures structures and patterns inherent in the raw data. First, we explore sparse representation and propose a novel sparse matrix factorization method for learning a dictionary in both a reconstructive and discriminative manner. The obtained representations can be directly used for multi-class classification. We also apply sparse representation on a camera trap dataset for wildlife monitoring and demonstrate good performance of sparse features in a challenging real world scenario. Second, from a theoretical perspective, we show that the popular ℓ1-norm based methods break down in the presence of high coherence and large noise. We introduce a novel regularization approach to handle model collinearity and obtain parsimonious variable selection simultaneously. The regularization term is non-convex and can take into account structured sparsity (e.g., group sparsity). We propose an efficient iterative thresholding procedure for solving the optimization. Our method achieves state-of-the-art performance for super-resolution signal spectrum estimation. On the other hand, in order to enhance the discriminative power of learned features, supervised learning is crucial. A proper metric is desired for various problems, such as image retrieval, similarity learning and face verification. We propose a ranking based metric learning algorithm under maximum margin criterion. We propose both batch and online algorithms. The regret bounds are given for online algorithms. Experiments are conducted on 3D human body shape matching problem and state-of-the-art performance is achieved.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2019-08-01","The student, Jiangping Wang, accepted the attached license on 2017-07-05 at 20:52.","The student, Jiangping Wang, submitted this Dissertation for approval on 2017-07-05 at 21:13.","This Dissertation was approved for publication on 2017-07-06 at 16:03.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11318 on 2017-09-29 at 10:46:42","Made available in DSpace on 2017-09-29T17:45:21Z (GMT). No. of bitstreams: 2 WANG-DISSERTATION-2017.pdf: 14169937 bytes, checksum: 883cfbfe67b6ec092ea8095e81cc269d (MD5) LICENSE.txt: 4211 bytes, checksum: c3351c1c1ff86815e8cc45018ca1142e (MD5) Previous issue date: 2017-07-06","Embargo set by: Colleen Fallaw for item 103459 Lift date: 2019-09-29T17:48:06Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 103459 Lift date: 2020-03-02T19:56:41Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 103459 Lift date: 2020-03-02T19:59:52Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 103459 Lift date: 2020-03-02T20:02:46Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 103459 on 2020-03-03T10:15:32Z."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Learning sparse features and metric in signal and image processing"]}]}],"canonical_facts":{"dc:contributor":["Huang, Thomas","Hasegawa-Johnson, Mark","Liang, Zhi-Pei","Liang, Feng"],"dc:creator":["Wang, Jiangping"],"dc:date":["2017-09-29T17:45:21Z","2020-03-03T10:15:32Z","2017-07-06","2017-08"],"dc:description":["This dissertation studies two aspects of feature learning: representation learning and metric in feature space, from a machine learning perspective. Feature learning is a fundamental problem in computer vision and machine learning. First introduced in computational neuroscience in the context of sparse coding in the visual system, sparse coding plays a key role in feature representation learning, as the over-complete dictionary allows more representation flexibility and efficiency, and captures structures and patterns inherent in the raw data. First, we explore sparse representation and propose a novel sparse matrix factorization method for learning a dictionary in both a reconstructive and discriminative manner. The obtained representations can be directly used for multi-class classification. We also apply sparse representation on a camera trap dataset for wildlife monitoring and demonstrate good performance of sparse features in a challenging real world scenario. Second, from a theoretical perspective, we show that the popular ℓ1-norm based methods break down in the presence of high coherence and large noise. We introduce a novel regularization approach to handle model collinearity and obtain parsimonious variable selection simultaneously. The regularization term is non-convex and can take into account structured sparsity (e.g., group sparsity). We propose an efficient iterative thresholding procedure for solving the optimization. Our method achieves state-of-the-art performance for super-resolution signal spectrum estimation. On the other hand, in order to enhance the discriminative power of learned features, supervised learning is crucial. A proper metric is desired for various problems, such as image retrieval, similarity learning and face verification. We propose a ranking based metric learning algorithm under maximum margin criterion. We propose both batch and online algorithms. The regret bounds are given for online algorithms. Experiments are conducted on 3D human body shape matching problem and state-of-the-art performance is achieved.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2019-08-01","The student, Jiangping Wang, accepted the attached license on 2017-07-05 at 20:52.","The student, Jiangping Wang, submitted this Dissertation for approval on 2017-07-05 at 21:13.","This Dissertation was approved for publication on 2017-07-06 at 16:03.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11318 on 2017-09-29 at 10:46:42","Made available in DSpace on 2017-09-29T17:45:21Z (GMT). No. of bitstreams: 2 WANG-DISSERTATION-2017.pdf: 14169937 bytes, checksum: 883cfbfe67b6ec092ea8095e81cc269d (MD5) LICENSE.txt: 4211 bytes, checksum: c3351c1c1ff86815e8cc45018ca1142e (MD5) Previous issue date: 2017-07-06","Embargo set by: Colleen Fallaw for item 103459 Lift date: 2019-09-29T17:48:06Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 103459 Lift date: 2020-03-02T19:56:41Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 103459 Lift date: 2020-03-02T19:59:52Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 103459 Lift date: 2020-03-02T20:02:46Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 103459 on 2020-03-03T10:15:32Z."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/98199"],"dc:language":["en"],"dc:rights":["Copyright 2017 Jiangping Wang"],"dc:subject":["Feature learning","Sparse coding","Metric learning","Dictionary learning","Spectral analysis","Image classification","Wildlife monitoring","Shape matching"],"dc:title":["Learning sparse features and metric in signal and image processing"],"dc:type":["text"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:35Z"}