{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/16105"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/16105","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Distributed optimization in multi-agent systems: applications to distributed regression","abstract":"The context for this work is cooperative multi-agent systems (MAS). An agent is an intelligent entity that can measure some aspect of its environment, process information and possibly influence the environment through its action. A cooperative MAS can be defined as a loosely coupled network of agents that interact and cooperate to solve problems that are beyond the individual capabilities or knowledge of each agent. The focus of this thesis is distributed stochastic optimization in multi-agent systems. In distributed optimization, the complete optimization problem is not available at a single location but is distributed among different agents. The distributed optimization problem is additionally stochastic when the information available to each agent is with stochastic errors. Communication constraints, lack of global information about the network topology and the absence of coordinating agents make it infeasible to collect all the information at a single location and then treat it as a centralized optimization problem. Thus, the problem has to be solved using algorithms that are distributed, i.e., different parts of the algorithm are executed at different agents, and local, i.e., each agent uses only information locally available to it and other information it can obtain from its immediate neighbors. In this thesis, we will primarily focus on the specific problem of minimizing a sum of functions over a constraint set, when each component function is known partially (with stochastic errors) to a unique agent. The constraint set is known to all the agents. We propose three distributed and local algorithms, establish asymptotic convergence with diminishing stepsizes and obtain rate of convergence results. Stochastic errors, as we will see, arise naturally when the objective function known to an agent has a random variable with unknown statistics. Additionally, stochastic errors also model communication and quantization errors. The problem is motivated by distributed regression in sensor networks and power control in cellular systems. We also discuss an important extension to the above problem. In the extension, the network goal is to minimize a global function of a sum of component functions over a constraint set. Each component function is known to a unique network agent. The global function and the constraint set are known to all the agents. Unlike the previous problem, this problem is not stochastic. However, the objective function in this problem is more general. We propose an algorithm to solve this problem and establish its convergence.","abstract_html":"The context for this work is cooperative multi-agent systems (MAS). An agent is an intelligent entity that can measure some aspect of its environment, process information and possibly influence the environment through its action. A cooperative MAS can be defined as a loosely coupled network of agents that interact and cooperate to solve problems that are beyond the individual capabilities or knowledge of each agent. The focus of this thesis is distributed stochastic optimization in multi-agent systems. In distributed optimization, the complete optimization problem is not available at a single location but is distributed among different agents. The distributed optimization problem is additionally stochastic when the information available to each agent is with stochastic errors. Communication constraints, lack of global information about the network topology and the absence of coordinating agents make it infeasible to collect all the information at a single location and then treat it as a centralized optimization problem. Thus, the problem has to be solved using algorithms that are distributed, i.e., different parts of the algorithm are executed at different agents, and local, i.e., each agent uses only information locally available to it and other information it can obtain from its immediate neighbors. In this thesis, we will primarily focus on the specific problem of minimizing a sum of functions over a constraint set, when each component function is known partially (with stochastic errors) to a unique agent. The constraint set is known to all the agents. We propose three distributed and local algorithms, establish asymptotic convergence with diminishing stepsizes and obtain rate of convergence results. Stochastic errors, as we will see, arise naturally when the objective function known to an agent has a random variable with unknown statistics. Additionally, stochastic errors also model communication and quantization errors. The problem is motivated by distributed regression in sensor networks and power control in cellular systems. We also discuss an important extension to the above problem. In the extension, the network goal is to minimize a global function of a sum of component functions over a constraint set. Each component function is known to a unique network agent. The global function and the constraint set are known to all the agents. Unlike the previous problem, this problem is not stochastic. However, the objective function in this problem is more general. We propose an algorithm to solve this problem and establish its convergence.","abstract_has_math":false,"creators":["Srinivasan, Sundhar Ram"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Veeravalli, Venugopal V.","Nedich, Angelia","Srikant, Rayadurgam","Meyn, Sean P.","Jones, Douglas L."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2010,"date_issued":"2010-05-19T18:36:22Z","date_published":"2010-05-19T18:36:22Z","updated_at":"2026-07-22T22:25:08Z","subjects":["multi-agent systems","stochastic optimization","convex optimization","distributed optimization","regression","distributed regression"],"languages":["en"],"rights":["Copyright 2010 Sundhar Ram Srinivasan"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/16105","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Veeravalli, Venugopal V.","Nedich, Angelia","Srikant, Rayadurgam","Meyn, Sean P.","Jones, Douglas L."]},{"key":"dc:creator","label":"Author","values":["Srinivasan, Sundhar Ram"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2010-05-19T18:36:22Z","2010-5"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["multi-agent systems","stochastic optimization","convex optimization","distributed optimization","regression","distributed regression"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2010 Sundhar Ram Srinivasan"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/16105"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The context for this work is cooperative multi-agent systems (MAS). An agent is an intelligent entity that can measure some aspect of its environment, process information and possibly influence the environment through its action. A cooperative MAS can be defined as a loosely coupled network of agents that interact and cooperate to solve problems that are beyond the individual capabilities or knowledge of each agent. The focus of this thesis is distributed stochastic optimization in multi-agent systems. In distributed optimization, the complete optimization problem is not available at a single location but is distributed among different agents. The distributed optimization problem is additionally stochastic when the information available to each agent is with stochastic errors. Communication constraints, lack of global information about the network topology and the absence of coordinating agents make it infeasible to collect all the information at a single location and then treat it as a centralized optimization problem. Thus, the problem has to be solved using algorithms that are distributed, i.e., different parts of the algorithm are executed at different agents, and local, i.e., each agent uses only information locally available to it and other information it can obtain from its immediate neighbors. In this thesis, we will primarily focus on the specific problem of minimizing a sum of functions over a constraint set, when each component function is known partially (with stochastic errors) to a unique agent. The constraint set is known to all the agents. We propose three distributed and local algorithms, establish asymptotic convergence with diminishing stepsizes and obtain rate of convergence results. Stochastic errors, as we will see, arise naturally when the objective function known to an agent has a random variable with unknown statistics. Additionally, stochastic errors also model communication and quantization errors. The problem is motivated by distributed regression in sensor networks and power control in cellular systems. We also discuss an important extension to the above problem. In the extension, the network goal is to minimize a global function of a sum of component functions over a constraint set. Each component function is known to a unique network agent. The global function and the constraint set are known to all the agents. Unlike the previous problem, this problem is not stochastic. However, the objective function in this problem is more general. We propose an algorithm to solve this problem and establish its convergence.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2009-12-08T21:19:43Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 2 Thesis.zip: 4276735 bytes, checksum: 85187e9e0e02ff626504e6e4e2d6480c (MD5) Srinivasan_SundharRam.pdf: 1019515 bytes, checksum: 35faf15c6bb69cf7f5bd711f0970708a (MD5)","Made available in DSpace on 2010-05-19T18:36:22Z (GMT). No. of bitstreams: 3 Thesis.zip: 4276735 bytes, checksum: 85187e9e0e02ff626504e6e4e2d6480c (MD5) Srinivasan_SundharRam.pdf: 1019515 bytes, checksum: 35faf15c6bb69cf7f5bd711f0970708a (MD5) license.txt: 4068 bytes, checksum: 4f58d9bcf1327306c9038b8a27caea50 (MD5)"]},{"key":"dc:title","label":"Title","values":["Distributed optimization in multi-agent systems: applications to distributed regression"]}]}],"canonical_facts":{"dc:contributor":["Veeravalli, Venugopal V.","Nedich, Angelia","Srikant, Rayadurgam","Meyn, Sean P.","Jones, Douglas L."],"dc:creator":["Srinivasan, Sundhar Ram"],"dc:date":["2010-05-19T18:36:22Z","2010-5"],"dc:description":["The context for this work is cooperative multi-agent systems (MAS). An agent is an intelligent entity that can measure some aspect of its environment, process information and possibly influence the environment through its action. A cooperative MAS can be defined as a loosely coupled network of agents that interact and cooperate to solve problems that are beyond the individual capabilities or knowledge of each agent. The focus of this thesis is distributed stochastic optimization in multi-agent systems. In distributed optimization, the complete optimization problem is not available at a single location but is distributed among different agents. The distributed optimization problem is additionally stochastic when the information available to each agent is with stochastic errors. Communication constraints, lack of global information about the network topology and the absence of coordinating agents make it infeasible to collect all the information at a single location and then treat it as a centralized optimization problem. Thus, the problem has to be solved using algorithms that are distributed, i.e., different parts of the algorithm are executed at different agents, and local, i.e., each agent uses only information locally available to it and other information it can obtain from its immediate neighbors. In this thesis, we will primarily focus on the specific problem of minimizing a sum of functions over a constraint set, when each component function is known partially (with stochastic errors) to a unique agent. The constraint set is known to all the agents. We propose three distributed and local algorithms, establish asymptotic convergence with diminishing stepsizes and obtain rate of convergence results. Stochastic errors, as we will see, arise naturally when the objective function known to an agent has a random variable with unknown statistics. Additionally, stochastic errors also model communication and quantization errors. The problem is motivated by distributed regression in sensor networks and power control in cellular systems. We also discuss an important extension to the above problem. In the extension, the network goal is to minimize a global function of a sum of component functions over a constraint set. Each component function is known to a unique network agent. The global function and the constraint set are known to all the agents. Unlike the previous problem, this problem is not stochastic. However, the objective function in this problem is more general. We propose an algorithm to solve this problem and establish its convergence.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2009-12-08T21:19:43Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 2 Thesis.zip: 4276735 bytes, checksum: 85187e9e0e02ff626504e6e4e2d6480c (MD5) Srinivasan_SundharRam.pdf: 1019515 bytes, checksum: 35faf15c6bb69cf7f5bd711f0970708a (MD5)","Made available in DSpace on 2010-05-19T18:36:22Z (GMT). No. of bitstreams: 3 Thesis.zip: 4276735 bytes, checksum: 85187e9e0e02ff626504e6e4e2d6480c (MD5) Srinivasan_SundharRam.pdf: 1019515 bytes, checksum: 35faf15c6bb69cf7f5bd711f0970708a (MD5) license.txt: 4068 bytes, checksum: 4f58d9bcf1327306c9038b8a27caea50 (MD5)"],"dc:identifier":["http://hdl.handle.net/2142/16105"],"dc:language":["en"],"dc:rights":["Copyright 2010 Sundhar Ram Srinivasan"],"dc:subject":["multi-agent systems","stochastic optimization","convex optimization","distributed optimization","regression","distributed regression"],"dc:title":["Distributed optimization in multi-agent systems: applications to distributed regression"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:08Z"}