{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/97374"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/97374","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Practical considerations for deep learning","abstract":"The student, Thomas Paine, submitted this Dissertation for approval on 2017-04-17 at 10:31.","abstract_html":"The student, Thomas Paine, submitted this Dissertation for approval on 2017-04-17 at 10:31.","abstract_has_math":false,"creators":["Paine, Thomas Le"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Informatics","degree_department":null,"school":null,"contributors":["Huang, Thomas","Liang, Zhi-Pei","Hoiem, Derek","Smaragdis, Paris"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2017,"date_issued":"2017-08-10T19:15:12Z","date_published":"2017-08-10T19:15:12Z","updated_at":"2026-07-22T22:24:34Z","subjects":["Deep learning","Computer vision"],"languages":["en"],"rights":["Copyright 2017 Thomas Paine"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/97374","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Huang, Thomas","Liang, Zhi-Pei","Hoiem, Derek","Smaragdis, Paris"]},{"key":"dc:creator","label":"Author","values":["Paine, Thomas Le"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2017-08-10T19:15:12Z","2017-04-17","2017-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Informatics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Deep learning","Computer vision"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2017 Thomas Paine"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/97374"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The student, Thomas Paine, submitted this Dissertation for approval on 2017-04-17 at 10:31.","This Dissertation was approved for publication on 2017-04-17 at 14:08.","DSpace SAF Submission Ingestion Package generated from Vireo submission #10798 on 2017-08-10 at 13:40:53","The work in this dissertation was done as a major shift in machine perception and deep learning research was happening. Neural networks have proved to be an important part of machine perception and other domains of artificial intelligence over the last several years. This is due to several advances that have made neural networks more practical for real world applications. The goal of this dissertation is to present several works that track some advances in deep learning including: the move from greedy unsupervised pre-training to end-to-end supervised learning, GPU accelerated training of large neural, and the more recent successes of auto-regressive models for generating high-dimensional data. This dissertation will present four of my works. The first, develops a novel convolutional auto-encoder, and shows it can learn useful features that improve supervised image classification results when data is scarce. The second, uses distributed systems with multiple GPUs to train neural networks. The third, develops a method for using neural networks for object detection in video. The fourth speeds up generation for auto-regressive models of time-series, i.e. Wavenet. Then I will conclude and describe some follow up research I would like to pursue including: work on speeding up generation for auto-regressive models of images, i.e. PixelCNN, and using dilated causal convolutional models for Reinforcement Learning.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-08-10 without embargo terms","The student, Thomas Paine, accepted the attached license on 2017-04-17 at 10:22.","Made available in DSpace on 2017-08-10T19:15:12Z (GMT). No. of bitstreams: 3 PAINE-DISSERTATION-2017.pdf: 18754268 bytes, checksum: 75d7095b9cbafcb6ba5c8ad47df846e8 (MD5) LICENSE.txt: 4209 bytes, checksum: 09c1984310c2efcb7b0276de1a380d88 (MD5) PROQUEST_LICENSE.txt: 4555 bytes, checksum: 6c3d0c7d4fa8c7855f0653aa18d2157d (MD5) Previous issue date: 2017-04-17"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Practical considerations for deep learning"]}]}],"canonical_facts":{"dc:contributor":["Huang, Thomas","Liang, Zhi-Pei","Hoiem, Derek","Smaragdis, Paris"],"dc:creator":["Paine, Thomas Le"],"dc:date":["2017-08-10T19:15:12Z","2017-04-17","2017-05"],"dc:description":["The student, Thomas Paine, submitted this Dissertation for approval on 2017-04-17 at 10:31.","This Dissertation was approved for publication on 2017-04-17 at 14:08.","DSpace SAF Submission Ingestion Package generated from Vireo submission #10798 on 2017-08-10 at 13:40:53","The work in this dissertation was done as a major shift in machine perception and deep learning research was happening. Neural networks have proved to be an important part of machine perception and other domains of artificial intelligence over the last several years. This is due to several advances that have made neural networks more practical for real world applications. The goal of this dissertation is to present several works that track some advances in deep learning including: the move from greedy unsupervised pre-training to end-to-end supervised learning, GPU accelerated training of large neural, and the more recent successes of auto-regressive models for generating high-dimensional data. This dissertation will present four of my works. The first, develops a novel convolutional auto-encoder, and shows it can learn useful features that improve supervised image classification results when data is scarce. The second, uses distributed systems with multiple GPUs to train neural networks. The third, develops a method for using neural networks for object detection in video. The fourth speeds up generation for auto-regressive models of time-series, i.e. Wavenet. Then I will conclude and describe some follow up research I would like to pursue including: work on speeding up generation for auto-regressive models of images, i.e. PixelCNN, and using dilated causal convolutional models for Reinforcement Learning.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-08-10 without embargo terms","The student, Thomas Paine, accepted the attached license on 2017-04-17 at 10:22.","Made available in DSpace on 2017-08-10T19:15:12Z (GMT). No. of bitstreams: 3 PAINE-DISSERTATION-2017.pdf: 18754268 bytes, checksum: 75d7095b9cbafcb6ba5c8ad47df846e8 (MD5) LICENSE.txt: 4209 bytes, checksum: 09c1984310c2efcb7b0276de1a380d88 (MD5) PROQUEST_LICENSE.txt: 4555 bytes, checksum: 6c3d0c7d4fa8c7855f0653aa18d2157d (MD5) Previous issue date: 2017-04-17"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/97374"],"dc:language":["en"],"dc:rights":["Copyright 2017 Thomas Paine"],"dc:subject":["Deep learning","Computer vision"],"dc:title":["Practical considerations for deep learning"],"dc:type":["text"],"thesis:degree_discipline":["Informatics"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:34Z"}