Results 31 to 40 of about 193,674 (278)
Running Markov Chain without Markov Basis [PDF]
18 ...
Hara, Hisayuki +2 more
openaire +2 more sources
Information geometry of Markov Kernels: a survey
Information geometry and Markov chains are two powerful tools used in modern fields such as finance, physics, computer science, and epidemiology. In this survey, we explore their intersection, focusing on the theoretical framework.
Geoffrey Wolfer, Shun Watanabe
doaj +1 more source
Approximating Markov chains. [PDF]
A common framework of finite state approximating Markov chains is developed for discrete time deterministic and stochastic processes. Two types of approximating chains are introduced: (i) those based on stationary conditional probabilities (time averaging) and (ii) transient, based on the percentage of the Lebesgue measure of the image of cells ...
openaire +2 more sources
Optimal choice of word length when comparing two Markov sequences using a χ 2-statistic
Background Alignment-free sequence comparison using counts of word patterns (grams, k-tuples) has become an active research topic due to the large amount of sequence data from the new sequencing technologies.
Xin Bai +4 more
doaj +1 more source
Markov Chains for Collaboration [PDF]
Consider a system of \(n\) players in which each initially starts on a different team. At each time step, we select an individual winner and an individual loser randomly and the loser joins the winner's team.
Mena, Robert, Murray, Will
core +1 more source
Hitting Times and Probabilities for Imprecise Markov Chains [PDF]
We consider the problem of characterising expected hitting times and hitting probabilities for imprecise Markov chains. To this end, we consider three distinct ways in which imprecise Markov chains have been defined in the literature: as sets of ...
De Bock, Jasper +2 more
core +2 more sources
Stochastic Processes with Expected Stopping Time [PDF]
Markov chains are the de facto finite-state model for stochastic dynamical systems, and Markov decision processes (MDPs) extend Markov chains by incorporating non-deterministic behaviors.
Krishnendu Chatterjee, Laurent Doyen
doaj +1 more source
The article introduces constraint Markov chains as a new tool for specification. They are a generalization of interval Markov chains. Interval Markov chains extend Markov chains by labeling transitions with intervals, implying that each transition probability needs to be within the according interval.
Caillaud, Benoit +5 more
openaire +4 more sources
Putting Markov Chains Back into Markov Chain Monte Carlo [PDF]
Markov chain theory plays an important role in statistical inference both in the formulation of models for data and in the construction of efficient algorithms for inference. The use of Markov chains in modeling data has a long history, however the use of Markov chain theory in developing algorithms for statistical inference has only become popular ...
Barker, Richard J. +1 more
openaire +1 more source
We study the strong law of large numbers for the frequencies of occurrence of states and ordered couples of states for countable Markov chains indexed by an infinite tree with uniformly bounded degree, which extends the corresponding results of countable
Bao Wang +3 more
doaj +1 more source

