Results 31 to 40 of about 3,741,395 (255)
Small sets and Markov transition densities [PDF]
, 2002 The theory of general state-space Markov chains can be strongly related to the case of discrete state-space by use of the notion of small sets and associated minorization conditions. The general theory shows that small sets exist for all Markov chains on
Montana, Giovanni, Kendall, W. S.
core +1 more source
Stochastic Processes with Expected Stopping Time [PDF]
Logical Methods in Computer ScienceMarkov chains are the de facto finite-state model for stochastic dynamical systems, and Markov decision processes (MDPs) extend Markov chains by incorporating non-deterministic behaviors.
Krishnendu Chatterjee, Laurent Doyen
doaj +1 more source
Multiplex Markov chains: Convection cycles and optimality
Physical Review Research, 2020 Multiplex networks are a common modeling framework for interconnected systems and multimodal data, yet we still lack fundamental insights for how multiplexity affects stochastic processes.
Dane Taylor
doaj +1 more source
Journal of Applied Mathematics, 2014 We study the strong law of large numbers for the frequencies of occurrence of states and ordered couples of states for countable Markov chains indexed by an infinite tree with uniformly bounded degree, which extends the corresponding results of countable
Bao Wang +3 more
doaj +1 more source
Algorithms for Markov Binomial Chains [PDF]
Logical Methods in Computer ScienceWe study algorithms to analyze a particular class of Markov population processes that is often used in epidemiology. More specifically, Markov binomial chains are the model that arises from stochastic time-discretizations of classical compartmental ...
Alejandro Alarcón Gonzalez +3 more
doaj +1 more source
Markov Chains and reliability analysis for reinforced concrete structure service life [PDF]
Materials Research, 2014 From field studies and the literature, it was found that the degradation of concrete over time can be modelled probabilistically using homogeneous Markov Chains. To confirm this finding, this study presents an application of Markov Chains associated with
Edna Possan +1 more
doaj +2 more sources
Polynomial Recurrence of Time-inhomogeneous Markov Chains
Austrian Journal of Statistics, 2023 This paper is devoted to establishing conditions that guarantee the existence of a p-th moment of the time it takes for a timeinhomogeneous Markov chain to hit some set C.
Vitaliy Golomoziy, Olha Moskanova
doaj +1 more source
, 2018 This book covers the classical theory of Markov chains on general state-spaces as well as many recent developments. The theoretical results are illustrated by simple examples, many of which are taken from Markov Chain Monte Carlo methods. The book is self-contained, while all the results are carefully and concisely proven.
Douc, Randal +3 more
openaire +3 more sources
New Zealand Journal of Mathematics, 2021 We introduce the space of virtual Markov chains (VMCs) as a projective limit of the spaces of all finite state space Markov chains (MCs), in the same way that the space of virtual permutations is the projective limit of the spaces of all permutations of finite sets.We introduce the notions of virtual initial distribution (VID) and a virtual transition ...
Evans, Steven, Jaffe, Adam Q.
openaire +4 more sources
Quantum Approximate Markov Chains are Thermal [PDF]
Communications in Mathematical Physics, 2016 We prove that any one-dimensional (1D) quantum state with small quantum conditional mutual information in all certain tripartite splits of the system, which we call a quantum approximate Markov chain, can be well-approximated by a Gibbs state of a short ...
Kohtaro Kato, F. Brandão
semanticscholar +1 more source