Results 191 to 200 of about 1,572 (217)

Transients in Markov Chains

IEEE Transactions on Electronic Computers, 1963
Jack Sklansky, Kenneth R. Kaplan
openaire   +2 more sources

On a ψ-Mixing property for Entangled Markov Chains

Physica A: Statistical Mechanics and Its Applications, 2023
Abdessatar Souissi
exaly  

On Markov chains and filtrations [PDF]

, 1997
In this paper we rederive some well known results for continuous time Markov processes that live on a finite state space.Martingale techniques are used throughout the paper. Special attention is paid to the construction of a continuous timeMarkov process, when we start from a discrete time Markov chain.
openaire   +2 more sources

Markov Chains and Monte Carlo Markov Chains

2013
The theory of Markov chains is rooted in the work of Russian mathematician Andrey Markov, and has an extensive body of literature to establish its mathematical foundations. The availability of computing resources has recently made it possible to use Markov chains to analyze a variety of scientific data, and Monte Carlo Markov chains are now one of the ...
openaire   +1 more source

Markov Chain Robustness.

When a Markov chain models nature or social interactions, it is likely not followed exactly, but only approximately. We therefore introduce several notions of robustness for a Markov chain P. Our standard adversary can dynamically change transition probabilities of P by 1 ± ε, and our strong adversary can completely control each transition ...
openaire   +2 more sources

Recurrence of a class of quantum Markov chains on trees

Chaos, Solitons and Fractals, 2022
Abdessatar Souissi, Abdessatar Barhoumi   +1 more
exaly  

Recursive Markov chains, stochastic grammars, and monotone systems of nonlinear equations

Journal of the ACM, 2009
Kousha Etessami, Mihalis Yannakakis
exaly  

Limit Theorems for Semi-Markov Processes and Renewal Theory for Markov Chains

Annals of Probability, 1978
K B Athreya, P Ney
exaly  

Geometric Bounds for Eigenvalues of Markov Chains

Annals of Applied Probability, 1991

exaly  

Markov chains

2001
openaire   +1 more source