{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/101651"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/101651","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Learning, inference, and control for construction robots and spatiotemporal processes","abstract":"Expert operators of real world robots, especially constructions robots, develop expertise from years of training and experience. In the absence of such experts, these robots are operated by novice operators, and this adversely affects the productivity. On the other hand, safety concerns and the nature of the operating environment limits the possibility of automating these robots. This thesis proposes a solution by considering a problem setting in which the robot learns a policy from experts to train novice human operators. Formally, this is posed as the problem of learning instructional policy from demonstration, that maps the state of the robot to an instruction for a human operator. Existing methods learn policy from demonstration, however such policies do not relate to the human operator's action space and hence cannot be used to generate instructions for novice operators. We introduce action primitives that address this challenge of mapping continuous state action trajectories to human parse-able and executable instructions. Construction tasks are complex as they consist of several subtasks with stochastic transitions. For such tasks, existing approaches learn policy for component subtask and then rely either on predefined decomposition or heuristics to generate policy for the entire task. To overcome this limitation, and to generate instructions for an entire construction task, this thesis proposes learning of a structured probabilistic model for instructional policy. This model utilizes hierarchy of Markov chains that incrementally captures the number of subtasks as well as their transitions. Switching between the subtasks is inferred using a likelihood rate based inference approach proposed in this thesis. Instructional policy model is tested based on a controlled group study involving 113 participants, who learn to perform the truck loading task on a hydraulic actuated scaled excavator robot. Further this thesis investigates shared control design for construction robots. Existing work has established that shared control can improve cycle times in nominal conditions. However, these methods can be too slow to relinquish control in off-nominal cases, when the operator needs to deviate from the nominally optimal trajectory due to unforeseen obstacles or other uncertainties. With an objective to incorporate such capability, this thesis proposes a new shared control technique that utilizes the operator's intent to quickly relinquish control in off-nominal conditions. Theoretical results with performance guarantees and improved obstacle reaction time are presented. Proposed design has been experimentally validated on Zermelo's navigation problem. The last part of the thesis introduces kernel observer for learning and inference of large-scale stochastic phenomena with both spatial and temporal (spatiotemporal) evolution. This work considers the problem of estimating the latent state of a spatiotemporally evolving continuous function using very few sensor measurements. The model consists of a dynamical systems prior over temporal evolution of weights of a kernel model. Theoretical results provide sufficient conditions on the number and spatial location of sensors required to guarantee state recovery. A lower bound on the minimum number of sensors required to robustly infer the hidden states is also derived. Finally, theoretical results for randomly selecting sensing or sampling locations based on the predictive kernel observer model are presented. Our approach outperforms state-of-the-art kernel based machine learning methods in numerical experiments on real world datasets.","abstract_html":"Expert operators of real world robots, especially constructions robots, develop expertise from years of training and experience. In the absence of such experts, these robots are operated by novice operators, and this adversely affects the productivity. On the other hand, safety concerns and the nature of the operating environment limits the possibility of automating these robots. This thesis proposes a solution by considering a problem setting in which the robot learns a policy from experts to train novice human operators. Formally, this is posed as the problem of learning instructional policy from demonstration, that maps the state of the robot to an instruction for a human operator. Existing methods learn policy from demonstration, however such policies do not relate to the human operator's action space and hence cannot be used to generate instructions for novice operators. We introduce action primitives that address this challenge of mapping continuous state action trajectories to human parse-able and executable instructions. Construction tasks are complex as they consist of several subtasks with stochastic transitions. For such tasks, existing approaches learn policy for component subtask and then rely either on predefined decomposition or heuristics to generate policy for the entire task. To overcome this limitation, and to generate instructions for an entire construction task, this thesis proposes learning of a structured probabilistic model for instructional policy. This model utilizes hierarchy of Markov chains that incrementally captures the number of subtasks as well as their transitions. Switching between the subtasks is inferred using a likelihood rate based inference approach proposed in this thesis. Instructional policy model is tested based on a controlled group study involving 113 participants, who learn to perform the truck loading task on a hydraulic actuated scaled excavator robot. Further this thesis investigates shared control design for construction robots. Existing work has established that shared control can improve cycle times in nominal conditions. However, these methods can be too slow to relinquish control in off-nominal cases, when the operator needs to deviate from the nominally optimal trajectory due to unforeseen obstacles or other uncertainties. With an objective to incorporate such capability, this thesis proposes a new shared control technique that utilizes the operator's intent to quickly relinquish control in off-nominal conditions. Theoretical results with performance guarantees and improved obstacle reaction time are presented. Proposed design has been experimentally validated on Zermelo's navigation problem. The last part of the thesis introduces kernel observer for learning and inference of large-scale stochastic phenomena with both spatial and temporal (spatiotemporal) evolution. This work considers the problem of estimating the latent state of a spatiotemporally evolving continuous function using very few sensor measurements. The model consists of a dynamical systems prior over temporal evolution of weights of a kernel model. Theoretical results provide sufficient conditions on the number and spatial location of sensors required to guarantee state recovery. A lower bound on the minimum number of sensors required to robustly infer the hidden states is also derived. Finally, theoretical results for randomly selecting sensing or sampling locations based on the predictive kernel observer model are presented. Our approach outperforms state-of-the-art kernel based machine learning methods in numerical experiments on real world datasets.","abstract_has_math":false,"creators":["Maske, Harshal"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Agricultural & Biological Engr","degree_department":null,"school":null,"contributors":["Chowdhary, Girish","Bretl, Timothy","Grift, Tony E.","Pagilla, Prabhakar"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018-09-27T16:30:12Z","date_published":"2018-09-27T16:30:12Z","updated_at":"2026-07-22T22:24:40Z","subjects":["Instructional Policy","Robot Learning","Shared control","Kernel Observer"],"languages":["en"],"rights":["Copyright 2018 Harshal Maske"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/101651","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Chowdhary, Girish","Bretl, Timothy","Grift, Tony E.","Pagilla, Prabhakar"]},{"key":"dc:creator","label":"Author","values":["Maske, Harshal"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2018-09-27T16:30:12Z","2020-09-28T09:15:22Z","2018-06-15","2018-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Agricultural & Biological Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Instructional Policy","Robot Learning","Shared control","Kernel Observer"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2018 Harshal Maske"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/101651"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Expert operators of real world robots, especially constructions robots, develop expertise from years of training and experience. In the absence of such experts, these robots are operated by novice operators, and this adversely affects the productivity. On the other hand, safety concerns and the nature of the operating environment limits the possibility of automating these robots. This thesis proposes a solution by considering a problem setting in which the robot learns a policy from experts to train novice human operators. Formally, this is posed as the problem of learning instructional policy from demonstration, that maps the state of the robot to an instruction for a human operator. Existing methods learn policy from demonstration, however such policies do not relate to the human operator's action space and hence cannot be used to generate instructions for novice operators. We introduce action primitives that address this challenge of mapping continuous state action trajectories to human parse-able and executable instructions. Construction tasks are complex as they consist of several subtasks with stochastic transitions. For such tasks, existing approaches learn policy for component subtask and then rely either on predefined decomposition or heuristics to generate policy for the entire task. To overcome this limitation, and to generate instructions for an entire construction task, this thesis proposes learning of a structured probabilistic model for instructional policy. This model utilizes hierarchy of Markov chains that incrementally captures the number of subtasks as well as their transitions. Switching between the subtasks is inferred using a likelihood rate based inference approach proposed in this thesis. Instructional policy model is tested based on a controlled group study involving 113 participants, who learn to perform the truck loading task on a hydraulic actuated scaled excavator robot. Further this thesis investigates shared control design for construction robots. Existing work has established that shared control can improve cycle times in nominal conditions. However, these methods can be too slow to relinquish control in off-nominal cases, when the operator needs to deviate from the nominally optimal trajectory due to unforeseen obstacles or other uncertainties. With an objective to incorporate such capability, this thesis proposes a new shared control technique that utilizes the operator's intent to quickly relinquish control in off-nominal conditions. Theoretical results with performance guarantees and improved obstacle reaction time are presented. Proposed design has been experimentally validated on Zermelo's navigation problem. The last part of the thesis introduces kernel observer for learning and inference of large-scale stochastic phenomena with both spatial and temporal (spatiotemporal) evolution. This work considers the problem of estimating the latent state of a spatiotemporally evolving continuous function using very few sensor measurements. The model consists of a dynamical systems prior over temporal evolution of weights of a kernel model. Theoretical results provide sufficient conditions on the number and spatial location of sensors required to guarantee state recovery. A lower bound on the minimum number of sensors required to robustly infer the hidden states is also derived. Finally, theoretical results for randomly selecting sensing or sampling locations based on the predictive kernel observer model are presented. Our approach outperforms state-of-the-art kernel based machine learning methods in numerical experiments on real world datasets.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2020-08-01","The student, Harshal Maske, accepted the attached license on 2018-06-14 at 15:57.","The student, Harshal Maske, submitted this Dissertation for approval on 2018-06-14 at 16:13.","This Dissertation was approved for publication on 2018-06-15 at 09:37.","DSpace SAF Submission Ingestion Package generated from Vireo submission #12631 on 2018-09-27 at 11:15:58","Made available in DSpace on 2018-09-27T16:30:12Z (GMT). No. of bitstreams: 3 MASKE-DISSERTATION-2018.pdf: 16935398 bytes, checksum: dd626d1151dbb4eab99b43f4fb7d2758 (MD5) LICENSE.txt: 4210 bytes, checksum: a56bc5fdbcc45c4d87e8eecb1ae4f03e (MD5) PROQUEST_LICENSE.txt: 4556 bytes, checksum: 744830649abf29b9df3073c95a3d08b9 (MD5) Previous issue date: 2018-06-15","Embargo set by: Seth Robbins for item 107749 Lift date: 2020-09-27T16:30:34Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 107749 Lift date: 2020-09-27T16:31:43Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 107749 Lift date: 2020-09-27T16:34:29Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 107749 on 2020-09-28T09:15:22Z."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Learning, inference, and control for construction robots and spatiotemporal processes"]}]}],"canonical_facts":{"dc:contributor":["Chowdhary, Girish","Bretl, Timothy","Grift, Tony E.","Pagilla, Prabhakar"],"dc:creator":["Maske, Harshal"],"dc:date":["2018-09-27T16:30:12Z","2020-09-28T09:15:22Z","2018-06-15","2018-08"],"dc:description":["Expert operators of real world robots, especially constructions robots, develop expertise from years of training and experience. In the absence of such experts, these robots are operated by novice operators, and this adversely affects the productivity. On the other hand, safety concerns and the nature of the operating environment limits the possibility of automating these robots. This thesis proposes a solution by considering a problem setting in which the robot learns a policy from experts to train novice human operators. Formally, this is posed as the problem of learning instructional policy from demonstration, that maps the state of the robot to an instruction for a human operator. Existing methods learn policy from demonstration, however such policies do not relate to the human operator's action space and hence cannot be used to generate instructions for novice operators. We introduce action primitives that address this challenge of mapping continuous state action trajectories to human parse-able and executable instructions. Construction tasks are complex as they consist of several subtasks with stochastic transitions. For such tasks, existing approaches learn policy for component subtask and then rely either on predefined decomposition or heuristics to generate policy for the entire task. To overcome this limitation, and to generate instructions for an entire construction task, this thesis proposes learning of a structured probabilistic model for instructional policy. This model utilizes hierarchy of Markov chains that incrementally captures the number of subtasks as well as their transitions. Switching between the subtasks is inferred using a likelihood rate based inference approach proposed in this thesis. Instructional policy model is tested based on a controlled group study involving 113 participants, who learn to perform the truck loading task on a hydraulic actuated scaled excavator robot. Further this thesis investigates shared control design for construction robots. Existing work has established that shared control can improve cycle times in nominal conditions. However, these methods can be too slow to relinquish control in off-nominal cases, when the operator needs to deviate from the nominally optimal trajectory due to unforeseen obstacles or other uncertainties. With an objective to incorporate such capability, this thesis proposes a new shared control technique that utilizes the operator's intent to quickly relinquish control in off-nominal conditions. Theoretical results with performance guarantees and improved obstacle reaction time are presented. Proposed design has been experimentally validated on Zermelo's navigation problem. The last part of the thesis introduces kernel observer for learning and inference of large-scale stochastic phenomena with both spatial and temporal (spatiotemporal) evolution. This work considers the problem of estimating the latent state of a spatiotemporally evolving continuous function using very few sensor measurements. The model consists of a dynamical systems prior over temporal evolution of weights of a kernel model. Theoretical results provide sufficient conditions on the number and spatial location of sensors required to guarantee state recovery. A lower bound on the minimum number of sensors required to robustly infer the hidden states is also derived. Finally, theoretical results for randomly selecting sensing or sampling locations based on the predictive kernel observer model are presented. Our approach outperforms state-of-the-art kernel based machine learning methods in numerical experiments on real world datasets.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2020-08-01","The student, Harshal Maske, accepted the attached license on 2018-06-14 at 15:57.","The student, Harshal Maske, submitted this Dissertation for approval on 2018-06-14 at 16:13.","This Dissertation was approved for publication on 2018-06-15 at 09:37.","DSpace SAF Submission Ingestion Package generated from Vireo submission #12631 on 2018-09-27 at 11:15:58","Made available in DSpace on 2018-09-27T16:30:12Z (GMT). No. of bitstreams: 3 MASKE-DISSERTATION-2018.pdf: 16935398 bytes, checksum: dd626d1151dbb4eab99b43f4fb7d2758 (MD5) LICENSE.txt: 4210 bytes, checksum: a56bc5fdbcc45c4d87e8eecb1ae4f03e (MD5) PROQUEST_LICENSE.txt: 4556 bytes, checksum: 744830649abf29b9df3073c95a3d08b9 (MD5) Previous issue date: 2018-06-15","Embargo set by: Seth Robbins for item 107749 Lift date: 2020-09-27T16:30:34Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 107749 Lift date: 2020-09-27T16:31:43Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 107749 Lift date: 2020-09-27T16:34:29Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 107749 on 2020-09-28T09:15:22Z."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/101651"],"dc:language":["en"],"dc:rights":["Copyright 2018 Harshal Maske"],"dc:subject":["Instructional Policy","Robot Learning","Shared control","Kernel Observer"],"dc:title":["Learning, inference, and control for construction robots and spatiotemporal processes"],"dc:type":["text"],"thesis:degree_discipline":["Agricultural & Biological Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:40Z"}