Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 49 for “"POMDP"”.
-
The Effectiveness of Social Plan Sharing in Online Planning in POMDP-type domains
This work examines how individual Partially Observable Markov Decision Process planning performance can be improved through the group-sharing of previous experiences and plans. Individual agents make use of a cache to map between beliefs and appropriate actions. Cache entries are shared between two …
-
A POMDP framework for antenna selection and user scheduling in multi-user massive MIMO systems
… a partially observable Markov decision process (POMDP) framework to design a resource allocation policy for downlink transmit beamforming at a multi-antenna BS that is equipped with a massive number of antennas and only a limited number of RF chains. Considering that channels evolve according to …
-
Approximate solution methods for partially observable Markov and semi-Markov decision processes
… Markov and semi-Markov decision processes (POMDP and POSMDP). One of the main contributions of this thesis is a lower cost approximation method for finite-space POMDPs with the average cost criterion, and its extensions to semi-Markov partially observable problems and constrained POMDP …
-
Planning with imperfect information : interceptor assignment
… a partially observable Markov decision process (POMDP) in order to account for the uncertainty in information. We use a POMDP solution algorithm to find an optimal policy for assigning interceptors to RVs in a single wave. From there, three cases are compared in a simulation of a single wave. …
-
Partially Observable Markov Process Decision Modeling for the Optimal Maintenance of Oil and Gas Pipelines
Partially Observable Markov Decision Process (POMDP) frameworks are employed across various fields. This dissertation studies the applications of POMDP for maintaining oil and gas pipelines. Pipeline maintenance operations comprise several uncertain elements, especially when addressing …
-
Trend Analysis of Belief-State History with Discrete Wavelet Transform for Improved Intention Discovery
… While most of the existing approaches use POMDP-based dialogue management, this thesis research proposes to introduce historical information of belief states into the POMDP model and to analyze its trend with discrete wavelet transformation (DWT). Accordingly, a new algorithm is developed …
-
Multi-objective optimization of next-generation aircraft collision avoidance software
… a partially-observable Markov decision process (POMDP) can dramatically increase system performance. However, the POMDP formulation relies on a number of design parameters modifying these parameters can dramatically alter system behavior. Prior work tunes these design parameters with respect to a …
-
Understanding user state and preferences for robust spoken dialog systems and location-aware assistive technology
… observable Markov decision process (SDS-POMDP). The SDSPOMDP can understand commands related to making phone calls and providing information about weather, activities, and menus in a specialized-care residence setting. Labeled utterance data was used to train observation and utterance …
-
Intelligent Knowledge Distribution for Multi-Agent Communication, Planning, and Learning
… Distribution (IKD), including Constrained-action POMDPs (CA-POMDP) and concurrent decentralized (CoDec) POMDPs for an agnostic plug-and-play capability for fully autonomous systems. Each agent runs a CoDec POMDP where all the decision making (motion planning, task allocation, asset monitoring, and …
-
Symbolic planning in belief space
… observable Markov decision process, or a POMDP, while benefiting from advantages of classical symbolic planning such as compact belief state expression, domain-independent heuristics, and structural simplicity. Belief space symbolic formalism, an extension of classical symbolic formalism, …
-
Efficient model learning for dialog management
Partially Observable Markov Decision Processes (POMDPs) have succeeded in many planning domains because they can optimally trade between actions that will increase an agent's knowledge about its environment and actions that will increase an agent's reward. However, POMDPs are defined with a large …
-
Planning under uncertainty for dynamic collision avoidance
… Partially Observable Markov Decision Process (POMDP) framework, and use generic MDP/POMDP solvers offline to compute vertical-only avoidance strategies that optimize a cost function to balance flight-plan deviation with risk of collision. We then describe a second framework that performs online …
-
Automated planning for hydrothermal vent prospecting using AUVs
… a partially-observable Markov decision process (POMDP), but with a very large state space (of the order of 10\(^{123}\) states). This size of problem is intractable for current POMDP solvers, so instead heuristic solutions were sought. The problem is one of chemical plume tracing, which can be …
-
Autonomous Quadcopter Videographer
… the combination of the reactive approach and a POMDP planner that considers the target's movement intentions. We compare the behavior of these two approaches under different target movement scenarios. The results show that the POMDP planner obtains more stable footage with less quadcopter motion.
-
Probabilistic roadmaps in uncertain environments
… a partially observable Markov Decision Process (POMDP). It is shown that the optimal policy can depend on accounting for the value of information from observations. The model scalability and the graph size that can be handled is then extended by conversion to a belief state Markov Decision …
-
Managing resources on a multi-modal sensing device for energy-aware state estimation
… partially observable Markov decision process (POMDP), for which numerous exact and approximate solutions are well known. We then demonstrate optimal sensing policies on a vehicle detection application. A sensing platform is developed consisting of an ultra-low power MSP430 Micro Controller Unit …
-
Mind-theoretic planning for social robots
… is combined into a Partially Observable MDP (POMDP). The presented MTP approach increases computational efficiency by taking advantage of approximation methods offered by a novel POMDP solver B3RTDP as well as leveraging value functions at various levels of the MSS as heuristics for value …
-
Optimization for stochastic, partially observed systems using a sampling-based approach to learn switched policies
… partially observable Markov decision processes (POMDPs) that require long time horizons for planning. Computing optimal policies for POMDPs is an intractable problem and, in practice, dimensionality renders exact solutions essentially unreachable for even small real-world systems of interest. For …
-
Deep Recurrent Q Networks for Dynamic Spectrum Access in Dynamic Heterogeneous Envirnments with Partial Observations
… Partially-Observable Markov Decision Process (POMDP), Deep Recurrent Q-Networks (DRQN) have been proposed to determine the optimal channel access policy via online learning. The fundamental goal of this dissertation is to develop DRL-based solutions to address this POMDP-DSA problem. We mainly …
-
Cooperative communications in wireless networks : novel approaches in the mac layer
… learning (RL) and partially observable MDP (POMDP) models are all able to significantly improve the throughput and energy consumption in a wireless network.
Page 1 of 3