Results 31 to 40 of about 771,482 (302)
Markov Chains and reliability analysis for reinforced concrete structure service life [PDF]
From field studies and the literature, it was found that the degradation of concrete over time can be modelled probabilistically using homogeneous Markov Chains. To confirm this finding, this study presents an application of Markov Chains associated with
Edna Possan +1 more
doaj +2 more sources
Polynomial Recurrence of Time-inhomogeneous Markov Chains
This paper is devoted to establishing conditions that guarantee the existence of a p-th moment of the time it takes for a timeinhomogeneous Markov chain to hit some set C.
Vitaliy Golomoziy, Olha Moskanova
doaj +1 more source
We study the strong law of large numbers for the frequencies of occurrence of states and ordered couples of states for countable Markov chains indexed by an infinite tree with uniformly bounded degree, which extends the corresponding results of countable
Bao Wang +3 more
doaj +1 more source
Algorithms for Markov Binomial Chains [PDF]
We study algorithms to analyze a particular class of Markov population processes that is often used in epidemiology. More specifically, Markov binomial chains are the model that arises from stochastic time-discretizations of classical compartmental ...
Alejandro Alarcón Gonzalez +3 more
doaj +1 more source
This book covers the classical theory of Markov chains on general state-spaces as well as many recent developments. The theoretical results are illustrated by simple examples, many of which are taken from Markov Chain Monte Carlo methods. The book is self-contained, while all the results are carefully and concisely proven.
Douc, Randal +3 more
openaire +3 more sources
Distributed Markov Chains [PDF]
The formal verification of large probabilistic models is challenging. Exploiting the concurrency that is often present is one way to address this problem. Here we study a class of communicating probabilistic agents in which the synchronizations determine the probability distribution for the next moves of the participating agents.
Ratul Saha +4 more
openaire +3 more sources
We introduce the space of virtual Markov chains (VMCs) as a projective limit of the spaces of all finite state space Markov chains (MCs), in the same way that the space of virtual permutations is the projective limit of the spaces of all permutations of finite sets.We introduce the notions of virtual initial distribution (VID) and a virtual transition ...
Evans, Steven, Jaffe, Adam Q.
openaire +4 more sources
Checking LTL Properties of Recursive Markov Chains [PDF]
We present algorithms for the qualitative and quantitative model checking of Linear Temporal Logic (LTL) properties for Recursive Markov Chains (RMCs). Recursive Markov Chains are a natural abstract model of procedural probabilistic programs and related ...
M. Yannakakis +3 more
core +1 more source
Matrix Analysis for Continuous-Time Markov Chains
Continuous-time Markov chains have transition matrices that vary continuously in time. Classical theory of nonnegative matrices, M-matrices and matrix exponentials is used in the literature to study their dynamics, probability distributions and other ...
Le Hung V., Tsatsomeros M. J.
doaj +1 more source
Markov Chain Models for Stock Prices Forecasts and Analysis [PDF]
Under the condition of complexity and volatility of financial markets, stock price prediction remains a challenging research topic. Markov chain models, with their “memoryless” nature, provide a probabilistic framework for analyzing stock price dynamics.
Jia Henghua
doaj +1 more source

