Results 11 to 20 of about 98,858 (265)
Two Approaches to the Construction of Perturbation Bounds for Continuous-Time Markov Chains
Mathematics, 2020 This paper is largely a review. It considers two main methods used to study stability and to obtain appropriate quantitative estimates of perturbations of (inhomogeneous) Markov chains with continuous time and a finite or countable state space.
Alexander Zeifman +2 more
doaj +3 more sources
Flow Faster: Efficient Decision Algorithms for Probabilistic Simulations [PDF]
Logical Methods in Computer Science, 2008 Strong and weak simulation relations have been proposed for Markov chains, while strong simulation and strong probabilistic simulation relations have been proposed for probabilistic automata.
Lijun Zhang +3 more
doaj +1 more source
Optimal control of multiple Markov-switching stochastic systems with numerical applications
Results in Control and Optimization, 2022 In this article the authors set up an optimal control framework for a hybrid stochastic system with dual or multiple Markov switching diffusion processes, while Markov chains governing these switching diffusions are not identical as assumed in the ...
Jianmin Shi
doaj +1 more source
Journal of Applied Mathematics, 2020 This paper deals with the computation of invariant measures and stationary expectations for discrete-time Markov chains governed by a block-structured one-step transition probability matrix.
Hendrik Baumann, Thomas Hanschke
doaj +1 more source
Calibration of Transition Intensities for a Multistate Model: Application to Long-Term Care
Risks, 2021 We consider a non-homogeneous continuous time Markov chain model for Long-Term Care with five states: the autonomous state, three dependent states of light, moderate and severe dependence levels and the death state.
Manuel L. Esquível +3 more
doaj +1 more source
Continuous-time controlled Markov chains
The Annals of Applied Probability, 2003 The authors consider continuous-time Markov decision processes with a denumerable state space and Borel action space where the cost and the transition rates are allowed to be unbounded. In the class of deterministic stationary policies they first give very weak conditions under which the existence of \(\varepsilon\)-optimal \((\varepsilon\geq 0 ...
Guo, Xianping +1 more
openaire +3 more sources
Markov Chain Models for Stock Prices Forecasts and Analysis [PDF]
ITM Web of ConferencesUnder the condition of complexity and volatility of financial markets, stock price prediction remains a challenging research topic. Markov chain models, with their “memoryless” nature, provide a probabilistic framework for analyzing stock price dynamics.
Jia Henghua
doaj +1 more source
A primer on stochastic epidemic models: Formulation, numerical simulation, and analysis
Infectious Disease Modelling, 2017 Some mathematical methods for formulation and numerical simulation of stochastic epidemic models are presented. Specifically, models are formulated for continuous-time Markov chains and stochastic differential equations. Some well-known examples are used
Linda J.S. Allen
doaj +1 more source
Journal of Probability and Statistics, 2014 We investigate random-time state-dependent Foster-Lyapunov analysis on subgeometric rate ergodicity of continuous-time Markov chains (CTMCs). We are mainly concerned with making use of the available results on deterministic state-dependent drift ...
Mokaedi V. Lekgari
doaj +1 more source