{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/97809"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/97809","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"From bits to information : learning meets compressive sensing","abstract":"A quantization approach to supervised learning, compressive sensing, and phase retrieval is presented in this thesis. We introduce a set of common techniques that allow us, in those three settings, to represent high dimensional data using the order statistics of linear and non linear measurements. We introduce new algorithms for signals classification in the multiclass and the multimodal settings, as well as algorithms for signals representation and recovery from quantized linear and quadratic measurements. We analyze the statistical consistency of our algorithms and prove their robustness to different sources of perturbation, as well as their computational efficiency. We present and analyze applications of our theoretical results in realistic setups, such as computer vision classification tasks, Audio-Visual Automatic Speech Recognition, lossy image compression and retrieval via locality sensitive hashing, locally linear estimation in large scale learning and Fourier sampling for phase retrieval - of particular interest in X-ray crystallography and super-resolution diffraction imaging applications. Our analysis of quantization based algorithms highlights interesting tradeoffs between memory complexity, sample complexity, and time complexity in algorithms design.","abstract_html":"A quantization approach to supervised learning, compressive sensing, and phase retrieval is presented in this thesis. We introduce a set of common techniques that allow us, in those three settings, to represent high dimensional data using the order statistics of linear and non linear measurements. We introduce new algorithms for signals classification in the multiclass and the multimodal settings, as well as algorithms for signals representation and recovery from quantized linear and quadratic measurements. We analyze the statistical consistency of our algorithms and prove their robustness to different sources of perturbation, as well as their computational efficiency. We present and analyze applications of our theoretical results in realistic setups, such as computer vision classification tasks, Audio-Visual Automatic Speech Recognition, lossy image compression and retrieval via locality sensitive hashing, locally linear estimation in large scale learning and Fourier sampling for phase retrieval - of particular interest in X-ray crystallography and super-resolution diffraction imaging applications. Our analysis of quantization based algorithms highlights interesting tradeoffs between memory complexity, sample complexity, and time complexity in algorithms design.","abstract_has_math":false,"creators":["Mroueh, Youssef"],"institution":"Massachusetts Institute of Technology","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.","school":null,"contributors":[],"advisors":["Tomaso Poggio and Lorenzo Rosasco."],"committee_chairs":[],"committee_members":[],"year":2015,"date_issued":"2015","date_published":"2015","updated_at":"2026-07-22T22:22:06Z","subjects":["Electrical Engineering and Computer Science."],"languages":["eng"],"rights":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."],"rights_urls":["http://dspace.mit.edu/handle/1721.1/7582"],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1721.1/97809","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Tomaso Poggio and Lorenzo Rosasco."]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:creator","label":"Author","values":["Mroueh, Youssef"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2015-07-17T19:48:53Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2015-07-17T19:48:53Z"]},{"key":"dc:date.issued","label":"Date","values":["2015"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Electrical Engineering and Computer Science."]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://dspace.mit.edu/handle/1721.1/7582"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1721.1/97809"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2015.","Cataloged from PDF version of thesis.","Includes bibliographical references (pages 174-182)."]},{"key":"dc:description.abstract","label":"Abstract","values":["A quantization approach to supervised learning, compressive sensing, and phase retrieval is presented in this thesis. We introduce a set of common techniques that allow us, in those three settings, to represent high dimensional data using the order statistics of linear and non linear measurements. We introduce new algorithms for signals classification in the multiclass and the multimodal settings, as well as algorithms for signals representation and recovery from quantized linear and quadratic measurements. We analyze the statistical consistency of our algorithms and prove their robustness to different sources of perturbation, as well as their computational efficiency. We present and analyze applications of our theoretical results in realistic setups, such as computer vision classification tasks, Audio-Visual Automatic Speech Recognition, lossy image compression and retrieval via locality sensitive hashing, locally linear estimation in large scale learning and Fourier sampling for phase retrieval - of particular interest in X-ray crystallography and super-resolution diffraction imaging applications. Our analysis of quantization based algorithms highlights interesting tradeoffs between memory complexity, sample complexity, and time complexity in algorithms design."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Ph. D."]},{"key":"dc:title","label":"Title","values":["From bits to information : learning meets compressive sensing"]}]}],"canonical_facts":{"dc:contributor.advisor":["Tomaso Poggio and Lorenzo Rosasco."],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:contributor.other":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:creator":["Mroueh, Youssef"],"dc:date.accessioned":["2015-07-17T19:48:53Z"],"dc:date.available":["2015-07-17T19:48:53Z"],"dc:date.issued":["2015"],"dc:description":["Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2015.","Cataloged from PDF version of thesis.","Includes bibliographical references (pages 174-182)."],"dc:description.abstract":["A quantization approach to supervised learning, compressive sensing, and phase retrieval is presented in this thesis. We introduce a set of common techniques that allow us, in those three settings, to represent high dimensional data using the order statistics of linear and non linear measurements. We introduce new algorithms for signals classification in the multiclass and the multimodal settings, as well as algorithms for signals representation and recovery from quantized linear and quadratic measurements. We analyze the statistical consistency of our algorithms and prove their robustness to different sources of perturbation, as well as their computational efficiency. We present and analyze applications of our theoretical results in realistic setups, such as computer vision classification tasks, Audio-Visual Automatic Speech Recognition, lossy image compression and retrieval via locality sensitive hashing, locally linear estimation in large scale learning and Fourier sampling for phase retrieval - of particular interest in X-ray crystallography and super-resolution diffraction imaging applications. Our analysis of quantization based algorithms highlights interesting tradeoffs between memory complexity, sample complexity, and time complexity in algorithms design."],"dc:description.degree":["Ph. D."],"dc:identifier.uri":["http://hdl.handle.net/1721.1/97809"],"dc:language.iso":["eng"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."],"dc:rights.uri":["http://dspace.mit.edu/handle/1721.1/7582"],"dc:subject":["Electrical Engineering and Computer Science."],"dc:title":["From bits to information : learning meets compressive sensing"],"dc:type":["Thesis"]},"updated_at":"2026-07-22T22:22:06Z"}