{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/124485"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/124485","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Distributed multi-agent learning under federated and competitive settings","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-05-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-05-01","abstract_has_math":false,"creators":["Qin, Tiancheng"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Industrial Engineering","degree_department":null,"school":null,"contributors":["Etesami, Rasoul","Srikant, Rayadurgam","Shamma, Jeff","Hu, Bin","Uribe, Cesar A."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-05","date_published":"2024-05","updated_at":"2026-07-22T22:25:02Z","subjects":["Distributed Learning","Federated Learning","Stochastic Game"],"languages":["en","eng"],"rights":["Copyright 2024 Tiancheng Qin"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/124485","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Etesami, Rasoul","Srikant, Rayadurgam","Shamma, Jeff","Hu, Bin","Uribe, Cesar A."]},{"key":"dc:creator","label":"Author","values":["Qin, Tiancheng"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-05","2024-02-13"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Industrial Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Distributed Learning","Federated Learning","Stochastic Game"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Tiancheng Qin"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/124485"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-05-01","The student, Tiancheng Qin, accepted the attached license on 2024-02-07 at 06:40.","The student, Tiancheng Qin, submitted this Dissertation for approval on 2024-02-07 at 06:42.","This Dissertation was approved for publication on 2024-02-13 at 16:03.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20217 on 2024-09-16 at 00:42:02","In recent years, the landscape of artificial intelligence (AI) has undergone a transformative evolution, transitioning from traditional single-agent approaches to more sophisticated and collaborative frameworks. The convergence of distributed computing and multi-agent systems has given rise to the powerful and versatile field of distributed multi-agent learning, allowing multiple agents to collaboratively learn and adapt in complex and dynamic environments. This intersection of distributed computing and multi-agent systems has ushered in a new era of intelligent systems capable of tackling intricate problems that were once deemed insurmountable for a single entity. Among the various topics in the field, in this thesis, we focus on two that bear significant importance, namely, Federated Learning and Learning in Stochastic Games. Federated Learning represents a paradigm shift from traditional centralized models, offering a decentralized approach where model training occurs locally on individual devices or servers, and only aggregated updates are shared. This transformative technique not only preserves data privacy but also addresses the challenges posed by the growing volume and diversity of data in our interconnected world. On the other hand, moving further from a collaborative scheme to a potentially competitive one, stochastic games emerge as a powerful framework to model multi-agent decision-making under uncertainty. Unlike traditional games, where players operate in a deterministic environment, stochastic games embrace the inherent unpredictability of real-world scenarios, where chance events and the actions of other players shape the unfolding dynamics. This nuanced approach enables modeling a wide range of complex systems, from economic competitions and environmental negotiations to multi-agent robotic interactions. In this thesis, we first analyze the convergence rate of the local stochastic gradient descent (SGD) algorithm (also known as Federated Averaging), arguably the most well-known and widely-used distributed optimization algorithm for Federated learning. Our contributions can be divided into two categories: (i) analysis of the effect of local steps in the convergence rate of Local SGD and (ii) analysis of the convergence rate of Local SGD for over-parameterized models. After that, we move further to the competitive scheme of stochastic games. Specifically, we study a subclass of $n$-player stochastic games, namely, stochastic games with independent chains and unknown transition matrices, and propose a scalable and independent decentralized learning algorithm that is provably convergent to the set of $\\epsilon$-Nash equilibrium policies."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Distributed multi-agent learning under federated and competitive settings"]}]}],"canonical_facts":{"dc:contributor":["Etesami, Rasoul","Srikant, Rayadurgam","Shamma, Jeff","Hu, Bin","Uribe, Cesar A."],"dc:creator":["Qin, Tiancheng"],"dc:date":["2024-05","2024-02-13"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-05-01","The student, Tiancheng Qin, accepted the attached license on 2024-02-07 at 06:40.","The student, Tiancheng Qin, submitted this Dissertation for approval on 2024-02-07 at 06:42.","This Dissertation was approved for publication on 2024-02-13 at 16:03.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20217 on 2024-09-16 at 00:42:02","In recent years, the landscape of artificial intelligence (AI) has undergone a transformative evolution, transitioning from traditional single-agent approaches to more sophisticated and collaborative frameworks. The convergence of distributed computing and multi-agent systems has given rise to the powerful and versatile field of distributed multi-agent learning, allowing multiple agents to collaboratively learn and adapt in complex and dynamic environments. This intersection of distributed computing and multi-agent systems has ushered in a new era of intelligent systems capable of tackling intricate problems that were once deemed insurmountable for a single entity. Among the various topics in the field, in this thesis, we focus on two that bear significant importance, namely, Federated Learning and Learning in Stochastic Games. Federated Learning represents a paradigm shift from traditional centralized models, offering a decentralized approach where model training occurs locally on individual devices or servers, and only aggregated updates are shared. This transformative technique not only preserves data privacy but also addresses the challenges posed by the growing volume and diversity of data in our interconnected world. On the other hand, moving further from a collaborative scheme to a potentially competitive one, stochastic games emerge as a powerful framework to model multi-agent decision-making under uncertainty. Unlike traditional games, where players operate in a deterministic environment, stochastic games embrace the inherent unpredictability of real-world scenarios, where chance events and the actions of other players shape the unfolding dynamics. This nuanced approach enables modeling a wide range of complex systems, from economic competitions and environmental negotiations to multi-agent robotic interactions. In this thesis, we first analyze the convergence rate of the local stochastic gradient descent (SGD) algorithm (also known as Federated Averaging), arguably the most well-known and widely-used distributed optimization algorithm for Federated learning. Our contributions can be divided into two categories: (i) analysis of the effect of local steps in the convergence rate of Local SGD and (ii) analysis of the convergence rate of Local SGD for over-parameterized models. After that, we move further to the competitive scheme of stochastic games. Specifically, we study a subclass of $n$-player stochastic games, namely, stochastic games with independent chains and unknown transition matrices, and propose a scalable and independent decentralized learning algorithm that is provably convergent to the set of $\\epsilon$-Nash equilibrium policies."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/124485"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Tiancheng Qin"],"dc:subject":["Distributed Learning","Federated Learning","Stochastic Game"],"dc:title":["Distributed multi-agent learning under federated and competitive settings"],"dc:type":["text"],"thesis:degree_discipline":["Industrial Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:02Z"}