Results 221 to 230 of about 5,928 (266)

Semi-Markov Decision Process With Partial Information for Maintenance Decisions

IEEE Transactions on Reliability, 2014
A critical factor that prevents optimal scheduling of maintenance interventions is the uncertainty regarding the current condition of the asset under consideration, as well as the rate at which deterioration takes place. However, current maintenance modeling and optimization techniques assume that the condition of the asset is either known, or assumed ...
Rengarajan Srinivasan, Ajith Kumar Parlikad   +1 more
openaire   +2 more sources

Discounted semi-markov decision process in a semi-markov environment

Optimization, 1997
This paper presents the discounted semi-Markov decision process (SMDP) with Borel state space in a semi-Markov environment. It describes a system which behaves like a SMDP except that the system is influenced by its semi-Markov process environment. Following each state transition of the environment, the parameters of the SMDP changes.
openaire   +1 more source

Application of Semi-Markov Decision Process in Bridge Management

IABSE Reports, 2015
<p>The state-of-the-art Bridge Management Systems (BMSs) feature tightly coupled deterioration and preservation optimization model that enable determining the most cost-effective maintenance strategies at both the project and network levels. In other to improve deterioration model, many authors suggest the application of Weibull distribution for ...
Rade Hajdin, Snežana Mašović, Saša Stošić   +2 more
openaire   +2 more sources

Semi-Markov decision processes with variance minimization criterion

4OR, 2014
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Qingda Wei, Xianping Guo
openaire   +3 more sources

Average cost semi-markov decision processes

Journal of Applied Probability, 1970
The semi-Markov decision model is considered under the criterion of long-run average cost. A new criterion, which for any policy considers the limit of the expected cost incurred during the first n transitions divided by the expected length of the first n transitions, is considered.
openaire   +2 more sources

Cost rate heuristics for semi-Markov decision processes

Journal of Applied Probability, 1992
In response to the computational complexity of the dynamic programming/backwards induction approach to the development of optimal policies for semi-Markov decision processes, we propose a class of heuristics resulting from an inductive process which proceeds forwards in time.
Glazebrook, K.D., Bailey, Michael P., Whitaker, Lyn R.   +2 more
openaire   +3 more sources

Constrained Semi-Markov decision processes with average rewards

ZOR Zeitschrift f�r Operations Research Mathematical Methods of Opeartions Research, 1994
This paper deals with constrained average reward semi-Markov decision processes with finite state and action sets. Two average reward criteria are considered, namely time average and ratio average. The author proved the existence of optimal mixed stationary policies and showed, under the unichain condition, the existence of randomized stationary ...
openaire   +2 more sources

Clustering Based Approximation Procedure for Semi-Markov Decision Processes with Incomplete State Information

Communications in Statistics - Theory and Methods, 2004
It is well-known that in practice it is rather difficult to calculate the minimal value function and optimal policies for decision processes with countable state space. Thus in general, approximation procedures are investigated. In this paper we show how
Dragut, M., Dragut, A.B.
exaly   +2 more sources

Generalized semi-Markov decision processes

Journal of Applied Probability, 1979
Various authors have derived the necessary and sufficient conditions for optimality in semi-Markov decision processes in which the state remains constant between jumps. In this paper similar results are presented for a generalized semi-Markov decision process in which the state varies between jumps according to a Markov process with continuous sample ...
openaire   +2 more sources

Inspection and maintenance planning: an application of semi-Markov decision processes

Journal of Intelligent Manufacturing, 1997
In this paper, we consider a system which deteriorates stochastically from one time unit to another. The state of the system, which is a continuous random variable, can be observed only by inspection. The goal of this paper is to derive a predictive maintenance policy which indicates, at each inspection and according to the observed value, whether a ...
Bérenguer, Christophe, Chu, Chengbin, Grall, Antoine   +2 more
openaire   +3 more sources