Results 41 to 50 of about 460,053 (229)
Generalized crested products of Markov chains [PDF]
We define a finite Markov chain, called generalized crested product, which naturally appears as a generalization of the first crested product of Markov chains. A complete spectral analysis is developed and the $k$-step transition probability is given. It
D'Angeli, Daniele, Donno, Alfredo
core +2 more sources
Semi-Markov graph dynamics. [PDF]
In this paper, we outline a model of graph (or network) dynamics based on two ingredients. The first ingredient is a Markov chain on the space of possible graphs. The second ingredient is a semi-Markov counting process of renewal type. The model consists
Marco Raberto+2 more
doaj +1 more source
In networking applications, one often wishes to obtain estimates about the number of objects at different parts of the network (e.g., the number of cars at an intersection of a road network or the number of packets expected to reach a node in a computer ...
Chaudhari, Harshal A.+2 more
core +1 more source
A New Improved Parsimonious Multivariate Markov Chain Model
We present a new improved parsimonious multivariate Markov chain model. Moreover, we find a new convergence condition with a new variability to improve the prediction accuracy and minimize the scale of the convergence condition.
Chao Wang, Ting-Zhu Huang
doaj +1 more source
Enabling Quantum Speedup of Markov Chains using a Multi-level Approach [PDF]
Quantum speedup for mixing a Markov chain can be achieved based on the construction of slowly-varying $r$ Markov chains where the initial chain can be easily prepared and the spectral gaps have uniform lower bound. The overall complexity is proportional to $r$.
arxiv
Quantum Markov chains associated with open quantum random walks [PDF]
In this paper we construct (nonhomogeneous) quantum Markov chains associated with open quantum random walks. The quantum Markov chain, like the classical Markov chain, is a fundamental tool for the investigation of the basic properties such as ...
Dhahri, Ameur+2 more
core +2 more sources
Dissipative control of a three-species food chain stochastic system with a hidden Markov chain
This paper focuses on a three-species food chain system which is formulated as stochastic differential equations with regime switching represented by a hidden Markov chain. Firstly, using the Wonham filter, we estimate the hidden Markov chain through the
Yonggang Ma+3 more
doaj +1 more source
Applying diffusion-based Markov chain Monte Carlo. [PDF]
We examine the performance of a strategy for Markov chain Monte Carlo (MCMC) developed by simulating a discrete approximation to a stochastic differential equation (SDE). We refer to the approach as diffusion MCMC.
Radu Herbei, Rajib Paul, L Mark Berliner
doaj +1 more source
Information-Preserving Markov Aggregation
We present a sufficient condition for a non-injective function of a Markov chain to be a second-order Markov chain with the same entropy rate as the original chain.
Geiger, Bernhard C., Temmel, Christoph
core +1 more source
A scaling analysis of a cat and mouse Markov chain [PDF]
Motivated by an original on-line page-ranking algorithm, starting from an arbitrary Markov chain $(C_n)$ on a discrete state space ${\cal S}$, a Markov chain $(C_n,M_n)$ on the product space ${\cal S}^2$, the cat and mouse Markov chain, is ...
Litvak, Nelly, Robert, Philippe
core +3 more sources