{"id":{"repo_id":"tamu","oai_identifier":"oai:oaktrust.library.tamu.edu:1969.1/199830"},"canonical_url":"https://search.dev.ndltd.org/etd/tamu/oai:oaktrust.library.tamu.edu:1969.1/199830","repository":{"repo_id":"tamu","name":"Texas A&M University","base_url":"https://oaktrust.library.tamu.edu/server/oai/request"},"display":{"title":"Network Offloading Policies for Cloud Robotics: Enhanced Situation Aware Robot Navigation Using Deep Reinforcement Learning","abstract":"In the case of resource-limited robots, such as low-power drones or 4-wheel vehicles, there can be a lack of sufficient onboard computation capabilities or battery limitations for implementing precise navigation models. One plausible solution to this issue is the use of cloud robotics, which could assign tasks to the cloud. However, when communicating with the cloud through congested wireless networks, latency or data loss may happen. Furthermore, when computations are excessively dependent on the cloud, bottlenecks could occur, adversely affecting the performance of navigation tasks for which real-time communications are necessary. To tackle this challenge, this research proposes a cloud-supported navigation system for resource-limited robots, which utilizes deep reinforcement learning to optimize strategies for offloading tasks to the cloud. This approach aims to control the quality of information obtained by the robot while minimizing the impact of potential communication issues. The offloading problem is formulated as a Markov Decision Process (MDP), and a reinforcement learning (RL) algorithm is applied to learn the optimized offloading policy. This method ensures efficient navigation decision-making even under constraints related to computation and energy resources. The proposed system is assessed through the use of pre-built navigation models within the ROS navigation stack, with experiments carried out in both simulation and real-world settings. At the end of the research, this paper intends to provide an evaluation of the system’s capabilities and limitations in various scenarios. The outcomes of these evaluations should indicate that the suggested system can substantially enhance navigation performance while concurrently reducing the expenses associated with cloud communication, which ultimately will provide for more efficient and reliable robotic navigation operations in different environments.","abstract_html":"In the case of resource-limited robots, such as low-power drones or 4-wheel vehicles, there can be a lack of sufficient onboard computation capabilities or battery limitations for implementing precise navigation models. One plausible solution to this issue is the use of cloud robotics, which could assign tasks to the cloud. However, when communicating with the cloud through congested wireless networks, latency or data loss may happen. Furthermore, when computations are excessively dependent on the cloud, bottlenecks could occur, adversely affecting the performance of navigation tasks for which real-time communications are necessary. To tackle this challenge, this research proposes a cloud-supported navigation system for resource-limited robots, which utilizes deep reinforcement learning to optimize strategies for offloading tasks to the cloud. This approach aims to control the quality of information obtained by the robot while minimizing the impact of potential communication issues. The offloading problem is formulated as a Markov Decision Process (MDP), and a reinforcement learning (RL) algorithm is applied to learn the optimized offloading policy. This method ensures efficient navigation decision-making even under constraints related to computation and energy resources. The proposed system is assessed through the use of pre-built navigation models within the ROS navigation stack, with experiments carried out in both simulation and real-world settings. At the end of the research, this paper intends to provide an evaluation of the system’s capabilities and limitations in various scenarios. The outcomes of these evaluations should indicate that the suggested system can substantially enhance navigation performance while concurrently reducing the expenses associated with cloud communication, which ultimately will provide for more efficient and reliable robotic navigation operations in different environments.","abstract_has_math":false,"creators":["Oh, Jahun"],"institution":"Texas A&M University","degree_name":"Master of Science","degree_level":"Masters","degree_discipline":"Computer Engineering","degree_department":null,"school":null,"contributors":[],"advisors":["Shakkottai, Srinivas"],"committee_chairs":[],"committee_members":["Choe, Yoonsuck","Seo, Jinsil"],"year":2023,"date_issued":"2023-07-10","date_published":"2023-07-10","updated_at":"2026-08-21T16:48:40Z","subjects":["Fog Robotics","Cloud Robotics","Reinforcement Learning","Resource Allocation","Network Offloading"],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1969.1/199830","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"source_record":{"url":"https://oaktrust.library.tamu.edu/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aoaktrust.library.tamu.edu%3A1969.1%2F199830","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Shakkottai, Srinivas"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Choe, Yoonsuck","Seo, Jinsil"]},{"key":"dc:creator","label":"Author","values":["Oh, Jahun"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2023-10-12T13:54:51Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2023-10-12T13:54:51Z"]},{"key":"dc:date.issued","label":"Date","values":["2023-07-10"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Texas A&M University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Fog Robotics","Cloud Robotics","Reinforcement Learning","Resource Allocation","Network Offloading"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1969.1/199830"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["In the case of resource-limited robots, such as low-power drones or 4-wheel vehicles, there can be a lack of sufficient onboard computation capabilities or battery limitations for implementing precise navigation models. One plausible solution to this issue is the use of cloud robotics, which could assign tasks to the cloud. However, when communicating with the cloud through congested wireless networks, latency or data loss may happen. Furthermore, when computations are excessively dependent on the cloud, bottlenecks could occur, adversely affecting the performance of navigation tasks for which real-time communications are necessary. To tackle this challenge, this research proposes a cloud-supported navigation system for resource-limited robots, which utilizes deep reinforcement learning to optimize strategies for offloading tasks to the cloud. This approach aims to control the quality of information obtained by the robot while minimizing the impact of potential communication issues. The offloading problem is formulated as a Markov Decision Process (MDP), and a reinforcement learning (RL) algorithm is applied to learn the optimized offloading policy. This method ensures efficient navigation decision-making even under constraints related to computation and energy resources. The proposed system is assessed through the use of pre-built navigation models within the ROS navigation stack, with experiments carried out in both simulation and real-world settings. At the end of the research, this paper intends to provide an evaluation of the system’s capabilities and limitations in various scenarios. The outcomes of these evaluations should indicate that the suggested system can substantially enhance navigation performance while concurrently reducing the expenses associated with cloud communication, which ultimately will provide for more efficient and reliable robotic navigation operations in different environments."]},{"key":"dc:format.mimetype","label":"Dc Format Mimetype","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Network Offloading Policies for Cloud Robotics: Enhanced Situation Aware Robot Navigation Using Deep Reinforcement Learning"]}]}],"canonical_facts":{"dc:contributor.advisor":["Shakkottai, Srinivas"],"dc:contributor.committeemember":["Choe, Yoonsuck","Seo, Jinsil"],"dc:creator":["Oh, Jahun"],"dc:date.accessioned":["2023-10-12T13:54:51Z"],"dc:date.available":["2023-10-12T13:54:51Z"],"dc:date.issued":["2023-07-10"],"dc:description.abstract":["In the case of resource-limited robots, such as low-power drones or 4-wheel vehicles, there can be a lack of sufficient onboard computation capabilities or battery limitations for implementing precise navigation models. One plausible solution to this issue is the use of cloud robotics, which could assign tasks to the cloud. However, when communicating with the cloud through congested wireless networks, latency or data loss may happen. Furthermore, when computations are excessively dependent on the cloud, bottlenecks could occur, adversely affecting the performance of navigation tasks for which real-time communications are necessary. To tackle this challenge, this research proposes a cloud-supported navigation system for resource-limited robots, which utilizes deep reinforcement learning to optimize strategies for offloading tasks to the cloud. This approach aims to control the quality of information obtained by the robot while minimizing the impact of potential communication issues. The offloading problem is formulated as a Markov Decision Process (MDP), and a reinforcement learning (RL) algorithm is applied to learn the optimized offloading policy. This method ensures efficient navigation decision-making even under constraints related to computation and energy resources. The proposed system is assessed through the use of pre-built navigation models within the ROS navigation stack, with experiments carried out in both simulation and real-world settings. At the end of the research, this paper intends to provide an evaluation of the system’s capabilities and limitations in various scenarios. The outcomes of these evaluations should indicate that the suggested system can substantially enhance navigation performance while concurrently reducing the expenses associated with cloud communication, which ultimately will provide for more efficient and reliable robotic navigation operations in different environments."],"dc:format.mimetype":["application/pdf"],"dc:identifier.uri":["https://hdl.handle.net/1969.1/199830"],"dc:language.iso":["en"],"dc:subject":["Fog Robotics","Cloud Robotics","Reinforcement Learning","Resource Allocation","Network Offloading"],"dc:title":["Network Offloading Policies for Cloud Robotics: Enhanced Situation Aware Robot Navigation Using Deep Reinforcement Learning"],"dc:type":["Thesis"],"thesis:degree_discipline":["Computer Engineering"],"thesis:degree_level":["Masters"],"thesis:degree_name":["Master of Science"],"thesis:institution_name":["Texas A&M University"]},"updated_at":"2026-08-21T16:48:40Z"}