Results 211 to 220 of about 13,577 (270)

On Average Reward Semi-Markov Decision Processes with a General Multichain Structure

Mathematics of Operations Research, 2004
In this paper we investigate average reward semi-Markov decision processes with a general multichain structure using a data-transformation method. By solving the transformed discrete-time average Markov decision processes, we can obtain significant and interesting information on the original average semi-Markov decision processes. If the original semi-
Jianyong Liu, Xiaobo Zhao
exaly   +3 more sources

SEMI-MARKOV DECISION PROCESSES

Probability in the Engineering and Informational Sciences, 2007
Considered are semi-Markov decision processes (SMDPs) with finite state and action spaces. We study two criteria: the expected average reward per unit time subject to a sample path constraint on the average cost per unit time and the expected time-average variability.
M. Baykal-Gürsoy, K. Gürsoy
openaire   +2 more sources

Risk-aware semi-Markov decision processes

2017 IEEE 56th Annual Conference on Decision and Control (CDC), 2017
In this work we construct a basic theory of risk-aware continuous-time Markov decision processes, and even more broadly, that of semi-Markov decision processes. Methods that account for the preferences of risk-aware agents have been introduced and studied in the context of discrete time problems, however, there has been virtually no such development ...
Jukka Isohataia, William B. Haskell 0001
openaire   +1 more source

Policy Gradient Semi-markov Decision Process

2008 20th IEEE International Conference on Tools with Artificial Intelligence, 2008
This paper proposes a simulation-based algorithm for optimizing the average reward in a parameterized continuous-time, finite-state semi-Markov decision process (SMDP). Our contributions are twofold: First, we compute the approximate gradient of the average reward with respect to the parameters in SMDP controlled by parameterized stochastic policies ...
Ngo, Vien, Chung, TaeChoong
openaire   +1 more source

Optimal replacement of a system according toa semi-Markov decision process in a semi-Markov environment

Optimization Methods and Software, 2003
This paper investigates an optimal replacement problem of a system in a semi-Markov environment. The system itself deteriorates according to a semi-Markov process, and is further influenced by its environment, which changes according to a semi-Markov process.
Qiying Hu, Wuyi Yue
openaire   +1 more source

Semi-Markov Decision Process With Partial Information for Maintenance Decisions

IEEE Transactions on Reliability, 2014
A critical factor that prevents optimal scheduling of maintenance interventions is the uncertainty regarding the current condition of the asset under consideration, as well as the rate at which deterioration takes place. However, current maintenance modeling and optimization techniques assume that the condition of the asset is either known, or assumed ...
Rengarajan Srinivasan   +1 more
openaire   +1 more source

Discounted semi-markov decision process in a semi-markov environment

Optimization, 1997
This paper presents the discounted semi-Markov decision process (SMDP) with Borel state space in a semi-Markov environment. It describes a system which behaves like a SMDP except that the system is influenced by its semi-Markov process environment. Following each state transition of the environment, the parameters of the SMDP changes.
openaire   +1 more source

Home - About - Disclaimer - Privacy