Results 281 to 290 of about 146,110 (315)
Some of the next articles are maybe not open access.
1997
Markov chains are central to the understanding of random processes. This is not only because they pervade the applications of random processes, but also because one can calculate explicitly many quantities of interest. This textbook, aimed at advanced undergraduate or MSc students with some background in basic probability theory, focuses on Markov ...
openaire +1 more source
Markov chains are central to the understanding of random processes. This is not only because they pervade the applications of random processes, but also because one can calculate explicitly many quantities of interest. This textbook, aimed at advanced undergraduate or MSc students with some background in basic probability theory, focuses on Markov ...
openaire +1 more source
2006
Motivated by the computational difficulty of analyzing very large Markov chains, we define a notion of clusters in (not necessarily reversible) Markov chains, and explore the possibility of analyzing a cluster “in vitro,” without regard to the remainder of the chain.
Nir Ailon, Steve Chien, Cynthia Dwork
openaire +1 more source
Motivated by the computational difficulty of analyzing very large Markov chains, we define a notion of clusters in (not necessarily reversible) Markov chains, and explore the possibility of analyzing a cluster “in vitro,” without regard to the remainder of the chain.
Nir Ailon, Steve Chien, Cynthia Dwork
openaire +1 more source
Factorization of Markov Chains
Journal of Theoretical Probability, 2004Let \(A\) be a (sub)stochastic \(d\times d\) matrix, with \(d=\infty\) possible. Existence of a factorization \(I-A=(I-B)(I-C)\) is proved for matrices \(B\) and \(C\) which are in particular triangular. The purpose is to solve in two steps equations \((I-A)x=g\) by recurrence. The author's paper [Sb. Math. 189, No.
openaire +2 more sources
The Markov chain of colourings
1995The Markov chain of good (proper) colourings of an n-vertex graph starts with an n-colouring and converges to a uniform distribution over all proper colourings with at most n colours. We study theoretically and experimentally the behaviour of this chain and concentrate in particular on a quantity μ which is the mean number of colours used in the ...
J. Eric Bartels, Dominic Welsh
openaire +1 more source
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
We propose a model called a pairwise Markov chain (PMC), which generalizes the classical hidden Markov chain (HMC) model. The generalization, which allows one to model more complex situations, in particular implies that in PMC the hidden process is not necessarily a Markov process.
openaire +1 more source
We propose a model called a pairwise Markov chain (PMC), which generalizes the classical hidden Markov chain (HMC) model. The generalization, which allows one to model more complex situations, in particular implies that in PMC the hidden process is not necessarily a Markov process.
openaire +1 more source
Theory of Probability & Its Applications, 1961
This paper discusses some new results related to ergodic and limit theorems and also to the repeated logarithm low for inhomogeneous Markov chains. Theorems are formulated and proved for conditions that were not treated in the literature; some estimates obtained previously by S. N. Bernshtein are employed.Lemma 1 is of greatest importance in the paper.
openaire +2 more sources
This paper discusses some new results related to ergodic and limit theorems and also to the repeated logarithm low for inhomogeneous Markov chains. Theorems are formulated and proved for conditions that were not treated in the literature; some estimates obtained previously by S. N. Bernshtein are employed.Lemma 1 is of greatest importance in the paper.
openaire +2 more sources
Annals of Mathematics and Artificial Intelligence, 2014
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire +2 more sources
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire +2 more sources
IEEE Transactions on Electronic Computers, 1963
Jack Sklansky, Kenneth R. Kaplan
openaire +2 more sources
Jack Sklansky, Kenneth R. Kaplan
openaire +2 more sources
On Markov chains and filtrations [PDF]
, 1997 In this paper we rederive some well known results for continuous time Markov processes that live on a finite state space.Martingale techniques are used throughout the paper. Special attention is paid to the construction of a continuous timeMarkov process, when we start from a discrete time Markov chain.
openaire +2 more sources