Results 201 to 210 of about 68,126 (238)

Inspection and maintenance planning: an application of semi-Markov decision processes

Journal of Intelligent Manufacturing, 1997
In this paper, we consider a system which deteriorates stochastically from one time unit to another. The state of the system, which is a continuous random variable, can be observed only by inspection. The goal of this paper is to derive a predictive maintenance policy which indicates, at each inspection and according to the observed value, whether a ...
Bérenguer, Christophe, Chu, Chengbin, Grall, Antoine   +2 more
openaire   +3 more sources

Application of Markov renewal theory and semi‐Markov decision processes in maintenance modeling and optimization of multi‐unit systems

Naval Research Logistics (NRL), 2020
AbstractIn this paper, a condition‐based maintenance model for a multi‐unit production system is proposed and analyzed using Markov renewal theory. The units of the system are subject to gradual deterioration, and the gradual deterioration process of each unit is described by a three‐state continuous time homogeneous Markov chain with two working ...
Nooshin Salari, Viliam Makis
openaire   +1 more source

Risk-sensitive semi-Markov decision processes with general utilities and multiple criteria

Advances in Applied Probability, 2018
Abstract In this paper we investigate risk-sensitive semi-Markov decision processes with a Borel state space, unbounded cost rates, and general utility functions. The performance criteria are several expected utilities of the total cost in a finite horizon. Our analysis is based on a type of finite-horizon occupation measure.
Huang, Yonghui, Lian, Zhaotong, Guo, Xianping   +2 more
openaire   +2 more sources

An Examination of Patient Referral and Discharge Policies Using a Multiple Objective Semi-Markov Decision Process

Journal of the Operational Research Society, 1979
A model is developed for determining an appropriate policy for referral or discharge of patients from the different modes of care in a progressive patient care facility. The objectives of the model are to achieve a high probability that the average patient recovers and to provide care at a low cost.
Schmee, Josef, Hannan, Edward L., Mirabile, Matthew P.   +2 more
openaire   +2 more sources

Average Cost Semi-Markov Decision Processes and the Control of Queueing Systems

Probability in the Engineering and Informational Sciences, 1989
Semi-Markov decision processes underlie the control of many queueing systems. In this paper, we deal with infinite state semi-Markov decision processes with nonnegative, unbounded costs and finite action sets. Axioms for the existence of an expected average cost optimal stationary policy are presented.
openaire   +1 more source

Performance sensitivity analysis and optimization for a class of countable semi-Markov decision processes

2011 9th World Congress on Intelligent Control and Automation, 2011
Markov process and semi-Markov process are widely used in many practical engineering problems. Based on the potential theory, the problems of sensitivity analysis of a class of countable Markov decision processes is given in this paper. Based on this, the corresponding problems are investigated for a class of semi-Markov decision processes.
null Yu Kang, null Baoqun Yin, null Weike Shang, null Hongsheng Xi   +3 more
openaire   +1 more source

A unified approach for semi-Markov decision processes with discounted and average reward criteria

Proceeding of the 11th World Congress on Intelligent Control and Automation, 2014
On the basis of the sensitivity-based optimization, we develop a unified optimization approach for semi-Markov decision processes (SMDPs) with infinite horizon discounted and average reward criteria. We show that the sensitivity formula under average reward criteria is a limitation case of discounted reward criteria.
Yanjie Li, Huijing Wang, Haoyao Chen
openaire   +1 more source

Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces

Optimization, 2013
This paper deals with the ratio and time expected average criteria for constrained semi-Markov decision processes (SMDPs). The state and action spaces are Polish spaces, the rewards and costs are unbounded from above and from below, and the mean holding times are allowed to be unbounded from above. First, under general conditions we prove the existence
Qingda Wei, Xianping Guo
openaire   +1 more source

Criteria for selecting the relaxation factor of the value iteration algorithm for undiscounted Markov and semi-Markov decision processes

Operations Research Letters, 1991
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Herzberg, Meir, Yechiali, Uri
openaire   +2 more sources

An Optimal Reprofiling Policy for High-Speed Train Wheels Subject to Wear and External Shocks Using a Semi-Markov Decision Process

IEEE Transactions on Reliability, 2018
Wheels are one of the three components of rail vehicles that are most affected by wear, having significant implications on safety and comfort. For the safety of vehicles, maintenance activities are needed for worn wheels to ensure their normal geometry, where reprofiling plays the most important role in maintenance.
E. Mingcheng, Bing Li, Zengqiang Jiang, Qi Li   +3 more
openaire   +1 more source