{"id":{"repo_id":"uts","oai_identifier":"oai:opus.lib.uts.edu.au:10453/173604"},"canonical_url":"https://search.dev.ndltd.org/etd/uts/oai:opus.lib.uts.edu.au:10453/173604","repository":{"repo_id":"uts","name":"University of Technology Sydney","base_url":"https://opus.lib.uts.edu.au/oai/request"},"display":{"title":"Trustworthy and Efficient Knowledge Sharing across Tasks in Deep Neural Networks","abstract":"Deep neural networks (DNNs) have revolutionized various fields with their superior performance on particular tasks. However, these tasks in real-world applications are often interrelated, raising the necessity for DNNs to share and transfer knowledge reliably and effectively between tasks. To solve this problem, we first develop a human understandable NeuroChains from the pre-trained model for each task, aiming to illuminate the reasoning process of the model for the given task and to foster trust in the shared knowledge. Next, based on the interpretable sparse network of each task, we enhance the efficiency of DNNs by leveraging the shared knowledge of existing tasks, thereby enabling the rapid and reliable creation of well-performing sparse models for new tasks. Finally, we further investigate the knowledge sharing of parameters in DNNs when tackling sequential tasks. We propose a novel approach to mitigate forgetting and enhance the fairness of DNNs across tasks. We conduct extensive experiments to demonstrate the efficacy of our proposed methods on convolutional neural networks and vision transformers across multiple datasets. Our proposed methods consistently outperform popular baseline methods in terms of accuracy and efficiency.","abstract_html":"Deep neural networks (DNNs) have revolutionized various fields with their superior performance on particular tasks. However, these tasks in real-world applications are often interrelated, raising the necessity for DNNs to share and transfer knowledge reliably and effectively between tasks. To solve this problem, we first develop a human understandable NeuroChains from the pre-trained model for each task, aiming to illuminate the reasoning process of the model for the given task and to foster trust in the shared knowledge. Next, based on the interpretable sparse network of each task, we enhance the efficiency of DNNs by leveraging the shared knowledge of existing tasks, thereby enabling the rapid and reliable creation of well-performing sparse models for new tasks. Finally, we further investigate the knowledge sharing of parameters in DNNs when tackling sequential tasks. We propose a novel approach to mitigate forgetting and enhance the fairness of DNNs across tasks. We conduct extensive experiments to demonstrate the efficacy of our proposed methods on convolutional neural networks and vision transformers across multiple datasets. Our proposed methods consistently outperform popular baseline methods in terms of accuracy and efficiency.","abstract_has_math":false,"creators":["Zhao, Haiyan"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023","date_published":"2023","updated_at":"2026-07-24T06:32:35Z","subjects":[],"languages":["en_US"],"rights":["info:eu-repo/semantics/openAccess","The author owns the copyright in this thesis including all reproduction and reuse rights for the work. The work may not be altered without the permission of the copyright owner. Attribution is essential when quoting or paraphrasing from this thesis.","© 2023 Haiyan Zhao","au.edu.uts.lib/cph"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/10453/173604","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Zhao, Haiyan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2023-11-28T03:15:21Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2023-11-28T03:15:21Z"]},{"key":"dc:date.issued","label":"Date","values":["2023"]},{"key":"dc:relation","label":"Dc Relation","values":["https://opus.lib.uts.edu.au/bitstream/10453/173604/1/thesis.pdf"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]},{"key":"dc:rights","label":"Dc Rights","values":["info:eu-repo/semantics/openAccess","The author owns the copyright in this thesis including all reproduction and reuse rights for the work. The work may not be altered without the permission of the copyright owner. Attribution is essential when quoting or paraphrasing from this thesis.","© 2023 Haiyan Zhao","au.edu.uts.lib/cph"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/10453/173604"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["University of Technology Sydney. Faculty of Engineering and Information Technology."]},{"key":"dc:description.abstract","label":"Abstract","values":["Deep neural networks (DNNs) have revolutionized various fields with their superior performance on particular tasks. However, these tasks in real-world applications are often interrelated, raising the necessity for DNNs to share and transfer knowledge reliably and effectively between tasks. To solve this problem, we first develop a human understandable NeuroChains from the pre-trained model for each task, aiming to illuminate the reasoning process of the model for the given task and to foster trust in the shared knowledge. Next, based on the interpretable sparse network of each task, we enhance the efficiency of DNNs by leveraging the shared knowledge of existing tasks, thereby enabling the rapid and reliable creation of well-performing sparse models for new tasks. Finally, we further investigate the knowledge sharing of parameters in DNNs when tackling sequential tasks. We propose a novel approach to mitigate forgetting and enhance the fairness of DNNs across tasks. We conduct extensive experiments to demonstrate the efficacy of our proposed methods on convolutional neural networks and vision transformers across multiple datasets. Our proposed methods consistently outperform popular baseline methods in terms of accuracy and efficiency."]},{"key":"dc:format","label":"Dc Format","values":["Thesis (PhD)"]},{"key":"dc:title","label":"Title","values":["Trustworthy and Efficient Knowledge Sharing across Tasks in Deep Neural Networks"]}]}],"canonical_facts":{"dc:creator":["Zhao, Haiyan"],"dc:date.accessioned":["2023-11-28T03:15:21Z"],"dc:date.available":["2023-11-28T03:15:21Z"],"dc:date.issued":["2023"],"dc:description":["University of Technology Sydney. Faculty of Engineering and Information Technology."],"dc:description.abstract":["Deep neural networks (DNNs) have revolutionized various fields with their superior performance on particular tasks. However, these tasks in real-world applications are often interrelated, raising the necessity for DNNs to share and transfer knowledge reliably and effectively between tasks. To solve this problem, we first develop a human understandable NeuroChains from the pre-trained model for each task, aiming to illuminate the reasoning process of the model for the given task and to foster trust in the shared knowledge. Next, based on the interpretable sparse network of each task, we enhance the efficiency of DNNs by leveraging the shared knowledge of existing tasks, thereby enabling the rapid and reliable creation of well-performing sparse models for new tasks. Finally, we further investigate the knowledge sharing of parameters in DNNs when tackling sequential tasks. We propose a novel approach to mitigate forgetting and enhance the fairness of DNNs across tasks. We conduct extensive experiments to demonstrate the efficacy of our proposed methods on convolutional neural networks and vision transformers across multiple datasets. Our proposed methods consistently outperform popular baseline methods in terms of accuracy and efficiency."],"dc:format":["Thesis (PhD)"],"dc:identifier.uri":["http://hdl.handle.net/10453/173604"],"dc:language.iso":["en_US"],"dc:relation":["https://opus.lib.uts.edu.au/bitstream/10453/173604/1/thesis.pdf"],"dc:rights":["info:eu-repo/semantics/openAccess","The author owns the copyright in this thesis including all reproduction and reuse rights for the work. The work may not be altered without the permission of the copyright owner. Attribution is essential when quoting or paraphrasing from this thesis.","© 2023 Haiyan Zhao","au.edu.uts.lib/cph"],"dc:title":["Trustworthy and Efficient Knowledge Sharing across Tasks in Deep Neural Networks"],"dc:type":["Thesis"]},"updated_at":"2026-07-24T06:32:35Z"}