Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 38 for “"Partially Observable Markov Decision Process"”.
-
Manufacturing Technology Adoption in Dynamic Product Environments
… of the technology investment problem: Stochastic Processes in the form of a Partially Observable Markov Decision Process, Non-Linear Mathematical Programming, and Computer Simulation integrated with a Multi-attribute Model based on measurement theory.
-
Symbolic planning in belief space
… which searches for a satisfying plan to a partially observable Markov decision process, or a POMDP, while benefiting from advantages of classical symbolic planning such as compact belief state expression, domain-independent heuristics, and structural simplicity. Belief space symbolic …
-
An integrated performance model learning and planning approach for optimal infrastructure facility maintenance under partial observability
Infrastructure inspection and maintenance decision making is a stochastic and partially observable problem. This thesis presents a learning and decision-making approach for developing optimal joint inspection and maintenance policies for civil infrastructure facilities under performance model …
-
Planning under uncertainty for dynamic collision avoidance
… We first formulate the problem within the Partially Observable Markov Decision Process (POMDP) framework, and use generic MDP/POMDP solvers offline to compute vertical-only avoidance strategies that optimize a cost function to balance flight-plan deviation with risk of collision. We then …
-
The Effectiveness of Social Plan Sharing in Online Planning in POMDP-type domains
This work examines how individual Partially Observable Markov Decision Process planning performance can be improved through the group-sharing of previous experiences and plans. Individual agents make use of a cache to map between beliefs and appropriate actions. Cache entries are shared between two …
-
Multi-objective optimization of next-generation aircraft collision avoidance software
… shown that formulating collision avoidance as a partially-observable Markov decision process (POMDP) can dramatically increase system performance. However, the POMDP formulation relies on a number of design parameters modifying these parameters can dramatically alter system behavior. Prior work …
-
Modeling Human Planning in Maze Orienteering Problems
… build models of human planning given their past decisions. In this thesis project, I focused on modeling human planning in Maze Orienteering Problems (MOP), an optimization problem with the objective to maximize collected rewards within a time limit in a partially known maze. The project has two …
-
Probabilistic roadmaps in uncertain environments
… of some edges are unknown. This is modelled as a decision-theoretic planning problem described through a partially observable Markov Decision Process (POMDP). It is shown that the optimal policy can depend on accounting for the value of information from observations. The model scalability and the …
-
Reactive, Autonomous, Markovian Sensor Tasking in Communication Starved Environments
… for evaluating these techniques. A suboptimal partially observable Markov decision process (POMDP) was used as the simulation framework to test various reward functions and decision algorithms while enabling autonomous, reactive sensor tasking. The goal of this work was used the developed …
-
Relatively robust grasping
… while grasping, we model the problem as a partially observable Markov decision process (POMDP). We derive a closed-loop strategy that maintains a belief state (a probability distribution over world states), and select actions with a receding horizon using forward search through the belief …
-
Managing resources on a multi-modal sensing device for energy-aware state estimation
… to existing sensor scheduling methods for hidden Markov models. We extend these methods, and cast the problem as a standard partially observable Markov decision process (POMDP), for which numerous exact and approximate solutions are well known. We then demonstrate optimal sensing policies on a …
-
Path planning and control of flying robots with account of human’s safety perception
… using a virtual reality environment. A hidden Markov model (HMM) is considered for estimation of latent variables, as user’s attention, intention, and emotional state. Then, an optimal motion planner generates a trajectory, parameterized in Bernstein polynomials, which minimizes the cost …
-
An extended Kalman filter extension of the augmented Markov decision process
… in this situation, planners, such as the partially observable Markov decision process, plan over the entire set of beliefs (distributions over the robot's position). Unfortunately, this approach is only tractable for problems with very few states. Between these two extreme approaches, …
-
Planning with imperfect information : interceptor assignment
… of RVs. This work formulates the problem as a partially observable Markov decision process (POMDP) in order to account for the uncertainty in information. We use a POMDP solution algorithm to find an optimal policy for assigning interceptors to RVs in a single wave. From there, three cases are …
-
Agent-based ethical decision-making control optimization framework for self-driving vehicles
… vehicle engineers. To address this problem, a decision-making algorithm is designed using philosophical concepts translated into mathematical frameworks. Deontological ethics parallels rule-based mathematical concepts, whereas consequentialism parallels cost-based mathematical concepts. The …
-
Automated planning for hydrothermal vent prospecting using AUVs
… to a problem that is naturally formulated as a partially-observable Markov decision process (POMDP), but with a very large state space (of the order of 10\(^{123}\) states). This size of problem is intractable for current POMDP solvers, so instead heuristic solutions were sought. The problem is …
-
Understanding user state and preferences for robust spoken dialog systems and location-aware assistive technology
… of a spoken dialog system modeled as a partially observable Markov decision process (SDS-POMDP). The SDSPOMDP can understand commands related to making phone calls and providing information about weather, activities, and menus in a specialized-care residence setting. Labeled utterance …
-
Deep Recurrent Q Networks for Dynamic Spectrum Access in Dynamic Heterogeneous Envirnments with Partial Observations
… approaches cannot solve the resulting online Partially-Observable Markov Decision Process (POMDP), Deep Recurrent Q-Networks (DRQN) have been proposed to determine the optimal channel access policy via online learning. The fundamental goal of this dissertation is to develop DRL-based solutions …
-
A POMDP framework for antenna selection and user scheduling in multi-user massive MIMO systems
We use a partially observable Markov decision process (POMDP) framework to design a resource allocation policy for downlink transmit beamforming at a multi-antenna BS that is equipped with a massive number of antennas and only a limited number of RF chains. Considering that channels evolve …
-
Wideband Spectrum Sensing and Signal Classification for Autonomous Self-Learning Cognitive Radios
… CR architecture is based on a sequence of signal processing and machine learning techniques that enable the Radiobot to sense a wide frequency band and act autonomously by learning from past experience. To achieve its goals, the proposed CR is equipped with the following functionalities: 1) …
Page 1 of 2