Developing approximation architectures for decision-making in real-time systems

This thesis studies the design of basis functions in approximate linear programming (ALP) as a decision-making tool. A case study on a robotic control problem shows that feature-based basis functions are very effective because they are able to capture the characteristics and cost structure of the problem. State-space partitioning, polynomials and other non-linear combinations of state parameters are also used in the ALP. However, design of these basis functions requires more trial-and-error. Simulation results show that control policy generated by the approximate linear programming algorithm matches and sometimes surpasses that of heuristics. Moreover, optimal policies are found well before value function estimates reach optimality. The ALP scales well with problem size and the number of basis functions required to find the optimal policy does not increase significantly in larger scale systems. The promising results shed light on the possibility of applying approximate linear programming to other large-scale problems that are computationally intractable using traditional dynamic programming methods.

Department dc:contributor.department

Massachusetts Institute of Technology. Dept. of Mechanical Engineering.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2006

Author dc:creator

• Ling, Lee, S.B. Massachusetts Institute of Technology

Advisor dc:contributor.advisor

• Daniela P. de Farias.

• Mechanical Engineering.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/36732

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/36732