Results 211 to 220 of about 71,442 (256)

Discounted semi-markov decision process in a semi-markov environment

Optimization, 1997
This paper presents the discounted semi-Markov decision process (SMDP) with Borel state space in a semi-Markov environment. It describes a system which behaves like a SMDP except that the system is influenced by its semi-Markov process environment. Following each state transition of the environment, the parameters of the SMDP changes.
openaire   +1 more source

Application of Semi-Markov Decision Process in Bridge Management

IABSE Reports, 2015
<p>The state-of-the-art Bridge Management Systems (BMSs) feature tightly coupled deterioration and preservation optimization model that enable determining the most cost-effective maintenance strategies at both the project and network levels. In other to improve deterioration model, many authors suggest the application of Weibull distribution for ...
Rade Hajdin, Snežana Mašović, Saša Stošić   +2 more
openaire   +2 more sources

Cost rate heuristics for semi-Markov decision processes

Journal of Applied Probability, 1992
In response to the computational complexity of the dynamic programming/backwards induction approach to the development of optimal policies for semi-Markov decision processes, we propose a class of heuristics resulting from an inductive process which proceeds forwards in time.
Glazebrook, K.D., Bailey, Michael P., Whitaker, Lyn R.   +2 more
openaire   +3 more sources

Uncertainty-Inflicted Event-Driven Resilient Recovery for Distribution Systems: A Semi-Markov Decision Process Approach

IEEE Transactions on Power Systems
Repair and reconfiguration are vital for power recovery after outages caused by natural disasters in distribution systems, but sequential and uncertainty-inflicted decision points due to uncertain repair periods make power recovery complicated.
Chong Wang, Gengfeng Li, Can Wan, Zhaoyu Wang, Ping Ju, Shunbo Lei   +5 more
semanticscholar   +1 more source

Semi-Infinitely Constrained Markov Decision Processes and Provably Efficient Reinforcement Learning

IEEE Transactions on Pattern Analysis and Machine Intelligence
We propose a novel generalization of constrained Markov decision processes (CMDPs) that we call the semi-infinitely constrained Markov decision process (SICMDP).
Liangyu Zhang, Yang Peng, Wenhao Yang, Zhihua Zhang   +3 more
semanticscholar   +1 more source

Average Cost Markov Decision Processes with Semi-Uniform Feller Transition Probabilities

Modern Trends in Controlled Stochastic Processes:, 2021
This paper studies average-cost Markov decision processes with semi-uniform Feller transition probabilities. This class of MDPs was recently introduced by the authors to study MDPs with incomplete information.
E. Feinberg, P. Kasyanov, M. Zgurovsky
semanticscholar   +1 more source

Optimal replacement of a system according toa semi-Markov decision process in a semi-Markov environment

Optimization Methods and Software, 2003
This paper investigates an optimal replacement problem of a system in a semi-Markov environment. The system itself deteriorates according to a semi-Markov process, and is further influenced by its environment, which changes according to a semi-Markov process.
Qiying Hu, Wuyi Yue
openaire   +1 more source

Generalized semi-Markov decision processes

Journal of Applied Probability, 1979
Various authors have derived the necessary and sufficient conditions for optimality in semi-Markov decision processes in which the state remains constant between jumps. In this paper similar results are presented for a generalized semi-Markov decision process in which the state varies between jumps according to a Markov process with continuous sample ...
openaire   +2 more sources

Error bounds of optimization algorithms for semi-Markov decision processes

International Journal of Systems Science, 2007
Cao's work shows that, by defining an α-dependent equivalent infinitesimal generator Aα, a semi-Markov decision process (SMDP) with both average- and discounted-cost criteria can be treated as an α-equivalent Markov decision process (MDP), and the performance potential theory can also be developed for SMDPs. In this work, we focus on establishing error
Tang Hao, Baoqun Yin, Hongsheng Xi
openaire   +1 more source

Inspection and maintenance planning: an application of semi-Markov decision processes

Journal of Intelligent Manufacturing, 1997
In this paper, we consider a system which deteriorates stochastically from one time unit to another. The state of the system, which is a continuous random variable, can be observed only by inspection. The goal of this paper is to derive a predictive maintenance policy which indicates, at each inspection and according to the observed value, whether a ...
Bérenguer, Christophe, Chu, Chengbin, Grall, Antoine   +2 more
openaire   +3 more sources