Results 21 to 30 of about 65,379 (309)
Running Markov Chain without Markov Basis [PDF]
18 ...
Hara, Hisayuki +2 more
openaire +2 more sources
Approximating Markov chains. [PDF]
A common framework of finite state approximating Markov chains is developed for discrete time deterministic and stochastic processes. Two types of approximating chains are introduced: (i) those based on stationary conditional probabilities (time averaging) and (ii) transient, based on the percentage of the Lebesgue measure of the image of cells ...
openaire +2 more sources
Information geometry of Markov Kernels: a survey
Information geometry and Markov chains are two powerful tools used in modern fields such as finance, physics, computer science, and epidemiology. In this survey, we explore their intersection, focusing on the theoretical framework.
Geoffrey Wolfer, Shun Watanabe
doaj +1 more source
Optimal choice of word length when comparing two Markov sequences using a χ 2-statistic
Background Alignment-free sequence comparison using counts of word patterns (grams, k-tuples) has become an active research topic due to the large amount of sequence data from the new sequencing technologies.
Xin Bai +4 more
doaj +1 more source
Stochastic Processes with Expected Stopping Time [PDF]
Markov chains are the de facto finite-state model for stochastic dynamical systems, and Markov decision processes (MDPs) extend Markov chains by incorporating non-deterministic behaviors.
Krishnendu Chatterjee, Laurent Doyen
doaj +1 more source
Markov Chains and reliability analysis for reinforced concrete structure service life [PDF]
From field studies and the literature, it was found that the degradation of concrete over time can be modelled probabilistically using homogeneous Markov Chains. To confirm this finding, this study presents an application of Markov Chains associated with
Edna Possan +1 more
doaj +2 more sources
The article introduces constraint Markov chains as a new tool for specification. They are a generalization of interval Markov chains. Interval Markov chains extend Markov chains by labeling transitions with intervals, implying that each transition probability needs to be within the according interval.
Caillaud, Benoit +5 more
openaire +4 more sources
Putting Markov Chains Back into Markov Chain Monte Carlo [PDF]
Markov chain theory plays an important role in statistical inference both in the formulation of models for data and in the construction of efficient algorithms for inference. The use of Markov chains in modeling data has a long history, however the use of Markov chain theory in developing algorithms for statistical inference has only become popular ...
Barker, Richard J. +1 more
openaire +1 more source
We study the strong law of large numbers for the frequencies of occurrence of states and ordered couples of states for countable Markov chains indexed by an infinite tree with uniformly bounded degree, which extends the corresponding results of countable
Bao Wang +3 more
doaj +1 more source
Multiplex Markov chains: Convection cycles and optimality
Multiplex networks are a common modeling framework for interconnected systems and multimodal data, yet we still lack fundamental insights for how multiplexity affects stochastic processes.
Dane Taylor
doaj +1 more source

