Results 131 to 140 of about 9,481,834 (176)

Semi-Markov decision processes with variance minimization criterion

4OR, 2014
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Qingda Wei, Xianping Guo
openaire   +3 more sources

Discounted semi-markov decision process in a semi-markov environment

Optimization, 1997
This paper presents the discounted semi-Markov decision process (SMDP) with Borel state space in a semi-Markov environment. It describes a system which behaves like a SMDP except that the system is influenced by its semi-Markov process environment. Following each state transition of the environment, the parameters of the SMDP changes.
openaire   +1 more source

Semi-Markov Decision Processes with Unbounded Rewards

Management Science, 1973
We consider a semi-Markov decision process with arbitrary action space; the state space is the nonnegative integers. As in queueing systems, we assume that {0, 1, 2, …, n + N} is the set of states accessible from state n in one transition, where N is finite and independent of n.
openaire   +1 more source

Average cost semi-markov decision processes

Journal of Applied Probability, 1970
The semi-Markov decision model is considered under the criterion of long-run average cost. A new criterion, which for any policy considers the limit of the expected cost incurred during the first n transitions divided by the expected length of the first n transitions, is considered.
openaire   +2 more sources

Cost rate heuristics for semi-Markov decision processes

Journal of Applied Probability, 1992
In response to the computational complexity of the dynamic programming/backwards induction approach to the development of optimal policies for semi-Markov decision processes, we propose a class of heuristics resulting from an inductive process which proceeds forwards in time.
Glazebrook, K.D., Bailey, Michael P., Whitaker, Lyn R.   +2 more
openaire   +3 more sources

Optimal replacement of a system according toa semi-Markov decision process in a semi-Markov environment

Optimization Methods and Software, 2003
This paper investigates an optimal replacement problem of a system in a semi-Markov environment. The system itself deteriorates according to a semi-Markov process, and is further influenced by its environment, which changes according to a semi-Markov process.
Qiying Hu, Wuyi Yue
openaire   +2 more sources

Constrained Semi-Markov decision processes with average rewards

ZOR Zeitschrift f�r Operations Research Mathematical Methods of Opeartions Research, 1994
This paper deals with constrained average reward semi-Markov decision processes with finite state and action sets. Two average reward criteria are considered, namely time average and ratio average. The author proved the existence of optimal mixed stationary policies and showed, under the unichain condition, the existence of randomized stationary ...
openaire   +2 more sources

Generalized semi-Markov decision processes

Journal of Applied Probability, 1979
Various authors have derived the necessary and sufficient conditions for optimality in semi-Markov decision processes in which the state remains constant between jumps. In this paper similar results are presented for a generalized semi-Markov decision process in which the state varies between jumps according to a Markov process with continuous sample ...
openaire   +2 more sources

Inspection and maintenance planning: an application of semi-Markov decision processes

Journal of Intelligent Manufacturing, 1997
In this paper, we consider a system which deteriorates stochastically from one time unit to another. The state of the system, which is a continuous random variable, can be observed only by inspection. The goal of this paper is to derive a predictive maintenance policy which indicates, at each inspection and according to the observed value, whether a ...
Bérenguer, Christophe, Chu, Chengbin, Grall, Antoine   +2 more
openaire   +3 more sources

On undiscounted semi-Markov decision processes with absorbing states

Mathematical Methods of Operations Research, 2015
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire   +1 more source