Results 1 to 10 of about 122,656 (170)
A Faster-Than Relation for Semi-Markov Decision Processes [PDF]
Electronic Proceedings in Theoretical Computer Science, 2020 When modeling concurrent or cyber-physical systems, non-functional requirements such as time are important to consider. In order to improve the timing aspects of a model, it is necessary to have some notion of what it means for a process to be faster ...
Mathias Ruggaard Pedersen +2 more
doaj +6 more sources
Quantum Semi-Markov Processes [PDF]
Physical Review Letters, 2008 We construct a large class of non-Markovian master equations that describe the dynamics of open quantum systems featuring strong memory effects, which relies on a quantum generalization of the concept of classical semi-Markov processes. General conditions for the complete positivity of the corresponding quantum dynamical maps are formulated.
H. P. Breuer, B. Vacchini
openaire +8 more sources
A discrete-time split-state framework for multi-state modeling with application to describing the course of heart disease [PDF]
BMC Medical Research MethodologyIn chronic disease epidemiology, the investigation of disease etiology has largely focused on an endpoint, while the course of chronic disease is understudied, representing a knowledge gap. Multi-state models can be used to describe the course of chronic
Ming Ding, Haiyi Chen, Feng-Chang Lin
doaj +2 more sources
A Continuous-Time Semi-Markov System Governed by Stepwise Transitions
Mathematics, 2022 In this paper, we introduce a class of stochastic processes in continuous time, called step semi-Markov processes. The main idea comes from bringing an additional insight to a classical semi-Markov process: the transition between two states is ...
Vlad Stefan Barbu +2 more
doaj +1 more source
Markov and Semi-Markov Chains, Processes, Systems, and Emerging Related Fields
Mathematics, 2021 Probability resembles the ancient Roman God Janus since, like Janus, probability also has a face with two different sides, which correspond to the metaphorical gateways and transitions between the past and the future [...]
P.-C.G. Vassiliou, Andreas C. Georgiou
doaj +1 more source
Controlled Discrete-Time Semi-Markov Random Evolutions and Their Applications
Mathematics, 2021 In this paper, we introduced controlled discrete-time semi-Markov random evolutions. These processes are random evolutions of discrete-time semi-Markov processes where we consider a control. applied to the values of random evolution.
Anatoliy Swishchuk, Nikolaos Limnios
doaj +1 more source
Open Markov Type Population Models: From Discrete to Continuous Time
Mathematics, 2021 We address the problem of finding a natural continuous time Markov type process—in open populations—that best captures the information provided by an open Markov chain in discrete time which is usually the sole possible observation from data.
Manuel L. Esquível +2 more
doaj +1 more source
Evaluation of Machinery Readiness Using Semi-Markov Processes
Applied Sciences, 2020 This article uses Markov and semi-Markov models as some of the most popular tools to estimate readiness and reliability. They allow to evaluate of both individual elements as well as entire systems—including production systems—as multi-state ...
Andrzej Świderski +3 more
doaj +1 more source
Non-Homogeneous Semi-Markov and Markov Renewal Processes and Change of Measure in Credit Risk
Mathematics, 2020 For a G-inhomogeneous semi-Markov chain and G-inhomogeneous Markov renewal processes, we study the change from real probability measure into a forward probability measure.
P.-C.G. Vassiliou
doaj +1 more source
A Two-Server Queue with Interdependence between Arrival and Service Processes
Mathematics, 2023 In this paper, we analyse a queueing system with two servers where the arrival and service processes are interdependent. The evolution of these processes is governed by transitions on the product space of three Markov chains, which are descriptors of the
Sindhu S +2 more
doaj +1 more source