Results 231 to 240 of about 401,816 (284)
Some of the next articles are maybe not open access.
Statistica Neerlandica, 1985
AbstractA review is presented of the development over the years of the theory and practical use of Markov decision processes. To this purpose three periods are considered: before 1966, from 1966 till 1972, and after 1973. In all 3 periods there has been some contribution from the Netherlands, but particularly in the last period the research in the ...
Wal, van der, J., Wessels, J.
openaire +1 more source
AbstractA review is presented of the development over the years of the theory and practical use of Markov decision processes. To this purpose three periods are considered: before 1966, from 1966 till 1972, and after 1973. In all 3 periods there has been some contribution from the Netherlands, but particularly in the last period the research in the ...
Wal, van der, J., Wessels, J.
openaire +1 more source
Theory of Probability & Its Applications, 1956
Let $\mathcal{E}$ be a metric space, and suppose that $\mathfrak{B}$ is the Borel field generated by the open sets of $\mathcal{E}$. A stochastic process is defined on $\mathcal{E}$ if a function $x(t,\omega )$$(0 \leqq t < \infty ,\omega \in \Omega )$ and a system of probability measures ${\bf P}_x (x \in \mathcal{E})$ are given such that all ${\bf P ...
Dynkin, E. B., Yushkevich, A. A.
openaire +2 more sources
Let $\mathcal{E}$ be a metric space, and suppose that $\mathfrak{B}$ is the Borel field generated by the open sets of $\mathcal{E}$. A stochastic process is defined on $\mathcal{E}$ if a function $x(t,\omega )$$(0 \leqq t < \infty ,\omega \in \Omega )$ and a system of probability measures ${\bf P}_x (x \in \mathcal{E})$ are given such that all ${\bf P ...
Dynkin, E. B., Yushkevich, A. A.
openaire +2 more sources
SIAM Journal on Applied Mathematics, 1973
A piecewise Markov process is a discrete-state, continuous-parameter stochastic process which is Markovian within contiguous time-segments. Starting at the beginning of a segment in some initial state, the process evolves in a Markovian manner until the segment terminates at a random time whose distribution is completely determined by the initial state.
openaire +2 more sources
A piecewise Markov process is a discrete-state, continuous-parameter stochastic process which is Markovian within contiguous time-segments. Starting at the beginning of a segment in some initial state, the process evolves in a Markovian manner until the segment terminates at a random time whose distribution is completely determined by the initial state.
openaire +2 more sources
Advances in Applied Probability, 1980
Interacting Markov processes are obtained by superimposing some type of interaction on many otherwise independent Markovian subsystems. As a result of the interaction, the subsystems fail to have the Markov property; the system as a whole remains Markovian, however. This subject has grown rapidly during the past decade.
openaire +1 more source
Interacting Markov processes are obtained by superimposing some type of interaction on many otherwise independent Markovian subsystems. As a result of the interaction, the subsystems fail to have the Markov property; the system as a whole remains Markovian, however. This subject has grown rapidly during the past decade.
openaire +1 more source
Theory of Probability & Its Applications, 1960
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire +2 more sources
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire +2 more sources
Russian Mathematical Surveys, 1973
This article is concerned with the foundations of the theory of Markov processes. We introduce the concepts of a regular Markov process and the class of such processes. We show that regular processes possess a number of good properties (strong Markov character, continuity on the right of excessive functions along almost all trajectories, and so on).
openaire +1 more source
This article is concerned with the foundations of the theory of Markov processes. We introduce the concepts of a regular Markov process and the class of such processes. We show that regular processes possess a number of good properties (strong Markov character, continuity on the right of excessive functions along almost all trajectories, and so on).
openaire +1 more source
2014
This chapter deals with Markov processes. It first defines the “Markov property” and shows that all the relevant information about a Markov process assuming values in a finite set of cardinality n can be captured by a nonnegative n x
openaire +1 more source
This chapter deals with Markov processes. It first defines the “Markov property” and shows that all the relevant information about a Markov process assuming values in a finite set of cardinality n can be captured by a nonnegative n x
openaire +1 more source