Results 221 to 230 of about 10,493 (262)

Functions of Semi-Markov Processes

SIAM Journal on Applied Mathematics, 1971
A necessary and sufficient condition is presented under which a function of a semi-Markov process is again a semi-Markov process with transition probabilities which do not depend on the initial distribution of the original process. This result is a generalization of a known result for Markov processes.
openaire   +1 more source

Semi-Markov Processes

2001
Let Q(x,A,t), x ∈ E, A ∈ e,t ∈ IR+, be a semi-Markov kernel on (E,e) and let (J n ,S n )n∈N and (J n ,X n )n∈N be, respectively, the associated MRP and the (J-X)-process (see Section 2.2).
N. Limnios, G. Oprişan
openaire   +1 more source

Regenerative generalized semi-markov processes

Communications in Statistics. Stochastic Models, 1987
The authors deal with a generalized semi-Markov process, which permits formal specification of some non-Markovian simulation models.
Haas, Peter J., Shedler, Gerald S.
openaire   +1 more source

On Integral of a Semi-Markov Diffusion Process

Journal of Mathematical Sciences, 2018
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire   +2 more sources

SEMI-MARKOV DECISION PROCESSES

Probability in the Engineering and Informational Sciences, 2007
Considered are semi-Markov decision processes (SMDPs) with finite state and action spaces. We study two criteria: the expected average reward per unit time subject to a sample path constraint on the average cost per unit time and the expected time-average variability.
M. Baykal-Gürsoy, K. Gürsoy
openaire   +1 more source

Applied semi-markov processes

2006
info:eu-repo/semantics ...
JANSSEN J., MANCA, Raimondo
openaire   +2 more sources

Semi-Markov failure rates processes

Applied Mathematics and Computation, 2011
Let \(\{\lambda(u):u\geq 0\}\) be a semi-Markov process defined by a Markov renewal kernel. The author studies the survival function \(R\) defined as the expectation of \(\exp \left(-\int_0^t\lambda(u)du\right)\), for \(t \geq 0\). Note that, \(R(t)\) is considered to be the reliability of an object with a random failure rate.
openaire   +1 more source

Semi-Markov Model of Damage Process

2016
Semi-Markov model of an object damage process is discussed in the paper. Presented here models deal with unrepairable object. The multi-state reliability functions and corresponding expectations, second moments and standard deviations are evaluated for the presented cases of the object damage.
openaire   +1 more source

On the entropy for semi-Markov processes

Journal of Applied Probability, 2003
The aim of this paper is to define the entropy of a finite semi-Markov process. We define the entropy of the finite distributions of the process, and obtain explicitly its entropy rate by extending the Shannon–McMillan–Breiman theorem to this class of nonstationary continuous-time processes.
Girardin, Valerie, Limnios, Nikolaos
openaire   +2 more sources

Discounted semi-markov decision process in a semi-markov environment

Optimization, 1997
This paper presents the discounted semi-Markov decision process (SMDP) with Borel state space in a semi-Markov environment. It describes a system which behaves like a SMDP except that the system is influenced by its semi-Markov process environment. Following each state transition of the environment, the parameters of the SMDP changes.
openaire   +1 more source