{"id":{"repo_id":"iupui","oai_identifier":"oai:scholarworks.indianapolis.iu.edu:1805/17923"},"canonical_url":"https://search.dev.ndltd.org/etd/iupui/oai:scholarworks.indianapolis.iu.edu:1805/17923","repository":{"repo_id":"iupui","name":"IUPUI","base_url":"https://scholarworks.indianapolis.iu.edu/server/oai/request"},"display":{"title":"Pruning Convolution Neural Network (SqueezeNet) for Efficient Hardware Deployment","abstract":"In recent years, deep learning models have become popular in the real-time embedded application, but there are many complexities for hardware deployment because of limited resources such as memory, computational power, and energy. Recent research in the field of deep learning focuses on reducing the model size of the Convolution Neural Network (CNN) by various compression techniques like Architectural compression, Pruning, Quantization, and Encoding (e.g., Huffman encoding). Network pruning is one of the promising technique to solve these problems. This thesis proposes methods to prune the convolution neural network (SqueezeNet) without introducing network sparsity in the pruned model. This thesis proposes three methods to prune the CNN to decrease the model size of CNN without a significant drop in the accuracy of the model. 1: Pruning based on Taylor expansion of change in cost function Delta C. 2: Pruning based on L2 normalization of activation maps. 3: Pruning based on a combination of method 1 and method 2. The proposed methods use various ranking methods to rank the convolution kernels and prune the lower ranked filters afterwards SqueezeNet model is fine-tuned by backpropagation. Transfer learning technique is used to train the SqueezeNet on the CIFAR-10 dataset. Results show that the proposed approach reduces the SqueezeNet model by 72% without a significant drop in the accuracy of the model (optimal pruning efficiency result). Results also show that Pruning based on a combination of Taylor expansion of the cost function and L2 normalization of activation maps achieves better pruning efficiency compared to other individual pruning criteria and most of the pruned kernels are from mid and high-level layers. The Pruned model is deployed on BlueBox 2.0 using RTMaps software and model performance was evaluated.","abstract_html":"In recent years, deep learning models have become popular in the real-time embedded application, but there are many complexities for hardware deployment because of limited resources such as memory, computational power, and energy. Recent research in the field of deep learning focuses on reducing the model size of the Convolution Neural Network (CNN) by various compression techniques like Architectural compression, Pruning, Quantization, and Encoding (e.g., Huffman encoding). Network pruning is one of the promising technique to solve these problems. This thesis proposes methods to prune the convolution neural network (SqueezeNet) without introducing network sparsity in the pruned model. This thesis proposes three methods to prune the CNN to decrease the model size of CNN without a significant drop in the accuracy of the model. 1: Pruning based on Taylor expansion of change in cost function Delta C. 2: Pruning based on L2 normalization of activation maps. 3: Pruning based on a combination of method 1 and method 2. The proposed methods use various ranking methods to rank the convolution kernels and prune the lower ranked filters afterwards SqueezeNet model is fine-tuned by backpropagation. Transfer learning technique is used to train the SqueezeNet on the CIFAR-10 dataset. Results show that the proposed approach reduces the SqueezeNet model by 72% without a significant drop in the accuracy of the model (optimal pruning efficiency result). Results also show that Pruning based on a combination of Taylor expansion of the cost function and L2 normalization of activation maps achieves better pruning efficiency compared to other individual pruning criteria and most of the pruned kernels are from mid and high-level layers. The Pruned model is deployed on BlueBox 2.0 using RTMaps software and model performance was evaluated.","abstract_has_math":false,"creators":["Gaikwad, Akash S."],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":["El-Sharkawy, Mohamed"],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018-12","date_published":"2018-12","updated_at":"2026-07-24T02:42:13Z","subjects":["Convolution neural network","CNN","SqueezeNet","Pruning","L2 Normalization","CIFAR-10","Transfer learning","Coarse pruning","S32V234","Taylor expansion","RTMaps","BlueBox","Fine pruning","Model compression","Activation maps"],"languages":["en_US"],"rights":["Attribution 3.0 United States"],"rights_urls":["http://creativecommons.org/licenses/by/3.0/us/"],"identifier_entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://dx.doi.org/10.7912/C2/2489"],"render_values":[{"text":"http://dx.doi.org/10.7912/C2/2489","href":"http://dx.doi.org/10.7912/C2/2489","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/1805/17923","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["El-Sharkawy, Mohamed"]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Rizkalla, Maher","King, Brian"]},{"key":"dc:creator","label":"Author","values":["Gaikwad, Akash S."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2018-12-05T21:36:36Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2018-12-05T21:36:36Z"]},{"key":"dc:date.issued","label":"Date","values":["2018-12"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Convolution neural network","CNN","SqueezeNet","Pruning","L2 Normalization","CIFAR-10","Transfer learning","Coarse pruning","S32V234","Taylor expansion","RTMaps","BlueBox","Fine pruning","Model compression","Activation maps"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution 3.0 United States"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://creativecommons.org/licenses/by/3.0/us/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1805/17923","http://dx.doi.org/10.7912/C2/2489"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Indiana University-Purdue University Indianapolis (IUPUI)"]},{"key":"dc:description.abstract","label":"Abstract","values":["In recent years, deep learning models have become popular in the real-time embedded application, but there are many complexities for hardware deployment because of limited resources such as memory, computational power, and energy. Recent research in the field of deep learning focuses on reducing the model size of the Convolution Neural Network (CNN) by various compression techniques like Architectural compression, Pruning, Quantization, and Encoding (e.g., Huffman encoding). Network pruning is one of the promising technique to solve these problems. This thesis proposes methods to prune the convolution neural network (SqueezeNet) without introducing network sparsity in the pruned model. This thesis proposes three methods to prune the CNN to decrease the model size of CNN without a significant drop in the accuracy of the model. 1: Pruning based on Taylor expansion of change in cost function Delta C. 2: Pruning based on L2 normalization of activation maps. 3: Pruning based on a combination of method 1 and method 2. The proposed methods use various ranking methods to rank the convolution kernels and prune the lower ranked filters afterwards SqueezeNet model is fine-tuned by backpropagation. Transfer learning technique is used to train the SqueezeNet on the CIFAR-10 dataset. Results show that the proposed approach reduces the SqueezeNet model by 72% without a significant drop in the accuracy of the model (optimal pruning efficiency result). Results also show that Pruning based on a combination of Taylor expansion of the cost function and L2 normalization of activation maps achieves better pruning efficiency compared to other individual pruning criteria and most of the pruned kernels are from mid and high-level layers. The Pruned model is deployed on BlueBox 2.0 using RTMaps software and model performance was evaluated."]},{"key":"dc:title","label":"Title","values":["Pruning Convolution Neural Network (SqueezeNet) for Efficient Hardware Deployment"]}]}],"canonical_facts":{"dc:contributor.advisor":["El-Sharkawy, Mohamed"],"dc:contributor.other":["Rizkalla, Maher","King, Brian"],"dc:creator":["Gaikwad, Akash S."],"dc:date.accessioned":["2018-12-05T21:36:36Z"],"dc:date.available":["2018-12-05T21:36:36Z"],"dc:date.issued":["2018-12"],"dc:description":["Indiana University-Purdue University Indianapolis (IUPUI)"],"dc:description.abstract":["In recent years, deep learning models have become popular in the real-time embedded application, but there are many complexities for hardware deployment because of limited resources such as memory, computational power, and energy. Recent research in the field of deep learning focuses on reducing the model size of the Convolution Neural Network (CNN) by various compression techniques like Architectural compression, Pruning, Quantization, and Encoding (e.g., Huffman encoding). Network pruning is one of the promising technique to solve these problems. This thesis proposes methods to prune the convolution neural network (SqueezeNet) without introducing network sparsity in the pruned model. This thesis proposes three methods to prune the CNN to decrease the model size of CNN without a significant drop in the accuracy of the model. 1: Pruning based on Taylor expansion of change in cost function Delta C. 2: Pruning based on L2 normalization of activation maps. 3: Pruning based on a combination of method 1 and method 2. The proposed methods use various ranking methods to rank the convolution kernels and prune the lower ranked filters afterwards SqueezeNet model is fine-tuned by backpropagation. Transfer learning technique is used to train the SqueezeNet on the CIFAR-10 dataset. Results show that the proposed approach reduces the SqueezeNet model by 72% without a significant drop in the accuracy of the model (optimal pruning efficiency result). Results also show that Pruning based on a combination of Taylor expansion of the cost function and L2 normalization of activation maps achieves better pruning efficiency compared to other individual pruning criteria and most of the pruned kernels are from mid and high-level layers. The Pruned model is deployed on BlueBox 2.0 using RTMaps software and model performance was evaluated."],"dc:identifier.uri":["https://hdl.handle.net/1805/17923","http://dx.doi.org/10.7912/C2/2489"],"dc:language.iso":["en_US"],"dc:rights":["Attribution 3.0 United States"],"dc:rights.uri":["http://creativecommons.org/licenses/by/3.0/us/"],"dc:subject":["Convolution neural network","CNN","SqueezeNet","Pruning","L2 Normalization","CIFAR-10","Transfer learning","Coarse pruning","S32V234","Taylor expansion","RTMaps","BlueBox","Fine pruning","Model compression","Activation maps"],"dc:title":["Pruning Convolution Neural Network (SqueezeNet) for Efficient Hardware Deployment"],"dc:type":["Thesis"]},"updated_at":"2026-07-24T02:42:13Z"}