\"Approximate dynamic programming formulation implemented with an Adaptive Critic (AC) based neural network (NN) structure has evolved as a powerful technique for solving the Hamilton-Jacobi-Bellman (HJB) equations. As interest in ADP and the AC solutions are escalating with time, there is a dire need to consider possible enabling factors for their implementations. A typical AC structure consists of two interacting NNs which is computationally expensive. In this work, a new architecture, called the \"Cost Function Based Single Network Adaptive Critic (J-SNAC)\" is presented that eliminates one of the networks in a typical AC structure. This approach is applicable to a wide class of nonlinear systems in engineering. In the first paper, two problems have been solved with the AC and the J-SNAC approaches. Results are presented that show savings of about 50% of the computational costs by J-SNAC while having the same accuracy levels of the dual network structure in solving for optimal control. In the second paper, the plant dynamics with parametric uncertainties or unmodeled nonlinearities has been considered. The author discusses the dynamic re-optimization of the J-SNAC controller that is used to capture the uncertainty but is not considered in the system model used for controller design. In the third paper, a non-quadratic cost function is used to incorporate control constraints. Necessary equations for optimal control are derived and an algorithm is presented to solve the constrained-control problem with J-SNAC. The fourth paper presents a new controller design technique for a class of nonlinear impulse driven systems\"--Abstract, page iii.
","abstract_html":"<p>"Approximate dynamic programming formulation implemented with an Adaptive Critic (AC) based neural network (NN) structure has evolved as a powerful technique for solving the Hamilton-Jacobi-Bellman (HJB) equations. As interest in ADP and the AC solutions are escalating with time, there is a dire need to consider possible enabling factors for their implementations. A typical AC structure consists of two interacting NNs which is computationally expensive. In this work, a new architecture, called the "Cost Function Based Single Network Adaptive Critic (J-SNAC)" is presented that eliminates one of the networks in a typical AC structure. This approach is applicable to a wide class of nonlinear systems in engineering. In the first paper, two problems have been solved with the AC and the J-SNAC approaches. Results are presented that show savings of about 50% of the computational costs by J-SNAC while having the same accuracy levels of the dual network structure in solving for optimal control. In the second paper, the plant dynamics with parametric uncertainties or unmodeled nonlinearities has been considered. The author discusses the dynamic re-optimization of the J-SNAC controller that is used to capture the uncertainty but is not considered in the system model used for controller design. In the third paper, a non-quadratic cost function is used to incorporate control constraints. Necessary equations for optimal control are derived and an algorithm is presented to solve the constrained-control problem with J-SNAC. The fourth paper presents a new controller design technique for a class of nonlinear impulse driven systems"--Abstract, page iii.</p>","abstract_has_math":false,"creators":["Ding, Jie"],"institution":"Missouri University of Science and Technology","degree_name":"Ph. D. in Mechanical Engineering","degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2016,"date_issued":"2016-02-10T08:00:00Z","date_published":"2016-02-10T08:00:00Z","updated_at":"2026-07-24T03:19:30Z","subjects":["Mechanical Engineering"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://scholarsmine.mst.edu/doctoral_dissertations/7","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Ding, Jie"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2016-02-10T08:00:00Z"]},{"key":"dc:type","label":"Dc Type","values":["Dissertation - Open Access"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph. D. in Mechanical Engineering"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Missouri University of Science and Technology"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Mechanical Engineering"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://scholarsmine.mst.edu/doctoral_dissertations/7"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["\"Approximate dynamic programming formulation implemented with an Adaptive Critic (AC) based neural network (NN) structure has evolved as a powerful technique for solving the Hamilton-Jacobi-Bellman (HJB) equations. As interest in ADP and the AC solutions are escalating with time, there is a dire need to consider possible enabling factors for their implementations. A typical AC structure consists of two interacting NNs which is computationally expensive. In this work, a new architecture, called the \"Cost Function Based Single Network Adaptive Critic (J-SNAC)\" is presented that eliminates one of the networks in a typical AC structure. This approach is applicable to a wide class of nonlinear systems in engineering. In the first paper, two problems have been solved with the AC and the J-SNAC approaches. Results are presented that show savings of about 50% of the computational costs by J-SNAC while having the same accuracy levels of the dual network structure in solving for optimal control. In the second paper, the plant dynamics with parametric uncertainties or unmodeled nonlinearities has been considered. The author discusses the dynamic re-optimization of the J-SNAC controller that is used to capture the uncertainty but is not considered in the system model used for controller design. In the third paper, a non-quadratic cost function is used to incorporate control constraints. Necessary equations for optimal control are derived and an algorithm is presented to solve the constrained-control problem with J-SNAC. The fourth paper presents a new controller design technique for a class of nonlinear impulse driven systems\"--Abstract, page iii.
"]},{"key":"dc:title","label":"Title","values":["Approximate dynamic programming solutions with a single network adaptive critic for a class of nonlinear systems"]}]}],"canonical_facts":{"dc:creator":["Ding, Jie"],"dc:date.available":["2016-02-10T08:00:00Z"],"dc:description.abstract":["\"Approximate dynamic programming formulation implemented with an Adaptive Critic (AC) based neural network (NN) structure has evolved as a powerful technique for solving the Hamilton-Jacobi-Bellman (HJB) equations. As interest in ADP and the AC solutions are escalating with time, there is a dire need to consider possible enabling factors for their implementations. A typical AC structure consists of two interacting NNs which is computationally expensive. In this work, a new architecture, called the \"Cost Function Based Single Network Adaptive Critic (J-SNAC)\" is presented that eliminates one of the networks in a typical AC structure. This approach is applicable to a wide class of nonlinear systems in engineering. In the first paper, two problems have been solved with the AC and the J-SNAC approaches. Results are presented that show savings of about 50% of the computational costs by J-SNAC while having the same accuracy levels of the dual network structure in solving for optimal control. In the second paper, the plant dynamics with parametric uncertainties or unmodeled nonlinearities has been considered. The author discusses the dynamic re-optimization of the J-SNAC controller that is used to capture the uncertainty but is not considered in the system model used for controller design. In the third paper, a non-quadratic cost function is used to incorporate control constraints. Necessary equations for optimal control are derived and an algorithm is presented to solve the constrained-control problem with J-SNAC. The fourth paper presents a new controller design technique for a class of nonlinear impulse driven systems\"--Abstract, page iii.
"],"dc:identifier":["https://scholarsmine.mst.edu/doctoral_dissertations/7"],"dc:subject":["Mechanical Engineering"],"dc:title":["Approximate dynamic programming solutions with a single network adaptive critic for a class of nonlinear systems"],"dc:type":["Dissertation - Open Access"],"thesis:degree_name":["Ph. D. in Mechanical Engineering"],"thesis:institution_name":["Missouri University of Science and Technology"]},"updated_at":"2026-07-24T03:19:30Z"}