Results 11 to 20 of about 31,071 (152)
Continuous time Markov chain approaches for analyzing transtheoretical models of health behavioral change: A case study and comparison of model estimations. [PDF]
Ma J, Chan W, Tilley BC.
europepmc +2 more sources
Bitcoin Selfish Mining Modeling and Dependability Analysis [PDF]
Blockchain technology has gained prominence over the last decade. Numerous achievements have been made regarding how this technology can be utilized in different aspects of the industry, market, and governmental departments.
Chencheng Zhou +3 more
doaj +1 more source
Markov Model of Cyber Attack Life Cycle Triggered by Software Vulnerability [PDF]
Software vulnerability life cycles illustrate changes in detection processes of software vulnerabilities during using computer systems. Unfortunately, the detection can be made by cyber-adversaries and a discovered software vulnerability may be ...
Romuald Hoffmann
doaj +1 more source
Optimal control of multiple Markov-switching stochastic systems with numerical applications
In this article the authors set up an optimal control framework for a hybrid stochastic system with dual or multiple Markov switching diffusion processes, while Markov chains governing these switching diffusions are not identical as assumed in the ...
Jianmin Shi
doaj +1 more source
Continuous-time controlled Markov chains
The authors consider continuous-time Markov decision processes with a denumerable state space and Borel action space where the cost and the transition rates are allowed to be unbounded. In the class of deterministic stationary policies they first give very weak conditions under which the existence of \(\varepsilon\)-optimal \((\varepsilon\geq 0 ...
Guo, Xianping +1 more
openaire +3 more sources
Imprecise continuous-time Markov chains
Continuous-time Markov chains are mathematical models that are used to describe the state-evolution of dynamical systems under stochastic uncertainty, and have found widespread applications in various fields. In order to make these models computationally tractable, they rely on a number of assumptions that may not be realistic for the domain of ...
Thomas Krak, Jasper De Bock, Arno Siebes
openaire +4 more sources
Event-Chain Monte Carlo: Foundations, Applications, and Prospects
This review treats the mathematical and algorithmic foundations of non-reversible Markov chains in the context of event-chain Monte Carlo (ECMC), a continuous-time lifted Markov chain that employs the factorized Metropolis algorithm. It analyzes a number
Werner Krauth
doaj +1 more source
Malaria is the world’s most fatal and challenging parasitic disease, caused by the Plasmodium parasite and transmitted to humans by the bites of infected female mosquitos.
Asma Akter Akhi +3 more
doaj +1 more source
Analyzing the profit-loss sharing contracts with Markov model
The purpose of this paper is to examine how to use first order Markov chain to build a reliable monitoring system for the profit-loss sharing based contracts (PLS) as the mode of financing contracts in Islamic bank with censored continuous-time ...
Imam Wahyudi, Ali Sakti
doaj +1 more source
In this paper it is shown, that if a possibly inhomogeneous Markov chain with continuous time and finite state space is weakly ergodic and all the entries of its intensity matrix are locally integrable, then, using available results from the perturbation
Yacov Satin +3 more
doaj +1 more source

