Results 211 to 220 of about 68,852 (252)

Dynamic Probabilistic Systems: Vol. 1: Markov Models; Vol. II: Semi-Markov and Decision Processes

Journal of the Operational Research Society, 1973
(1973). Dynamic Probabilistic Systems: Vol. 1: Markov Models; Vol. II: Semi-Markov and Decision Processes. Journal of the Operational Research Society: Vol. 24, No. 2, pp. 327-329.
N. A. J. Hastings, Ronald A. Howard
openaire   +2 more sources

Adaptive Markov and semi-Markov decision processes: a weak contrast function approach

Proceedings of the 27th IEEE Conference on Decision and Control, 2003
The authors consider the control of dynamic systems modeled as a family of either Markov or semi-Markov processes, parameterized by an unknown parameter alpha which takes values in a given finite set A. The true parameter alpha /sup 0/, which represents the real system, belongs to A.
R.A. Milito, J.B. Cruz
openaire   +1 more source

Optimal threshold probability and expectation in semi-Markov decision processes

Applied Mathematics and Computation, 2010
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Sakaguchi, Masahiko, Ohtsubo, Yoshio
openaire   +1 more source

Inspection and maintenance planning: an application of semi-Markov decision processes

Journal of Intelligent Manufacturing, 1997
In this paper, we consider a system which deteriorates stochastically from one time unit to another. The state of the system, which is a continuous random variable, can be observed only by inspection. The goal of this paper is to derive a predictive maintenance policy which indicates, at each inspection and according to the observed value, whether a ...
Bérenguer, Christophe, Chu, Chengbin, Grall, Antoine   +2 more
openaire   +3 more sources

Application of Markov renewal theory and semi‐Markov decision processes in maintenance modeling and optimization of multi‐unit systems

Naval Research Logistics (NRL), 2020
AbstractIn this paper, a condition‐based maintenance model for a multi‐unit production system is proposed and analyzed using Markov renewal theory. The units of the system are subject to gradual deterioration, and the gradual deterioration process of each unit is described by a three‐state continuous time homogeneous Markov chain with two working ...
Nooshin Salari, Viliam Makis
openaire   +1 more source

Risk-sensitive semi-Markov decision processes with general utilities and multiple criteria

Advances in Applied Probability, 2018
Abstract In this paper we investigate risk-sensitive semi-Markov decision processes with a Borel state space, unbounded cost rates, and general utility functions. The performance criteria are several expected utilities of the total cost in a finite horizon. Our analysis is based on a type of finite-horizon occupation measure.
Huang, Yonghui, Lian, Zhaotong, Guo, Xianping   +2 more
openaire   +2 more sources

Linear programming in tector criterion markov and semi-Markov decision processes

Optimization, 1989
Optimality problems in infinite horizon, discrete time, vector criterion Markov and semi-Markov decision processes are expressed as standard problems of multiobjective linear programming. Processes with discounting, absorbing processes and completely ergodie processes without discounting are investigated.
openaire   +1 more source

An Examination of Patient Referral and Discharge Policies Using a Multiple Objective Semi-Markov Decision Process

Journal of the Operational Research Society, 1979
A model is developed for determining an appropriate policy for referral or discharge of patients from the different modes of care in a progressive patient care facility. The objectives of the model are to achieve a high probability that the average patient recovers and to provide care at a low cost.
Schmee, Josef, Hannan, Edward L., Mirabile, Matthew P.   +2 more
openaire   +2 more sources

Average Cost Semi-Markov Decision Processes and the Control of Queueing Systems

Probability in the Engineering and Informational Sciences, 1989
Semi-Markov decision processes underlie the control of many queueing systems. In this paper, we deal with infinite state semi-Markov decision processes with nonnegative, unbounded costs and finite action sets. Axioms for the existence of an expected average cost optimal stationary policy are presented.
openaire   +1 more source

Performance sensitivity analysis and optimization for a class of countable semi-Markov decision processes

2011 9th World Congress on Intelligent Control and Automation, 2011
Markov process and semi-Markov process are widely used in many practical engineering problems. Based on the potential theory, the problems of sensitivity analysis of a class of countable Markov decision processes is given in this paper. Based on this, the corresponding problems are investigated for a class of semi-Markov decision processes.
null Yu Kang, null Baoqun Yin, null Weike Shang, null Hongsheng Xi   +3 more
openaire   +1 more source