Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 2 of 2 for “"controlled Markov chains"”.
-
Decomposition of Time Scales in Linear Systems and Markovian Decision Processes
… continuous and discrete time models. Finally, Markov chain models of stochastic systems with "weak" and "strong" transition probabilities lead to a singularly perturbed model from which we obtain the concept of the reduced order "aggregate" chain. For controlled Markov chains the aggregate …
-
Adaptive Control and Parameter Estimation in Markov Chains: A Quadratic Case
… in adaptive control and parameter estimation of Markov chains. In the first chapter, we introduce Markov chains and discuss some of their important properties. This chapter will help the reader understand the characteristics of Markov chains, which will be useful in later chapters discussing …