Results 241 to 250 of about 152,215 (282)

Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach

Mathematics of Operations Research, 2004
This paper introduces and develops a new approach to the theory of continuous time jump Markov decision processes (CTJMDP). This approach reduces discounted CTJMDPs to discounted semi-Markov decision processes (SMDPs) and eventually to discrete-time Markov decision processes (MDPs).
openaire   +4 more sources

The Transformation Method for Continuous-Time Markov Decision Processes

Journal of Optimization Theory and Applications, 2012
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Piunovskiy, Alexey, Zhang, Yi
openaire   +2 more sources

Preferred Rules in Continuous Time Markov Decision Processes

Management Science, 1974
Motivated by a planning horizon result for continuous time Markov decision chains, we study decision rules, called preferred, which may be used in the initially stationary part of nearly optimal policies. We characterize these rules and then, under conditions involving state recurrence and accessibility, consider finding such rules.
openaire   +2 more sources

Continuous time markov decision processes with interventions

Stochastics, 1983
We study Markov jump decision processes with both continuously and instantaneouslyacting decisions and with deterministic drift between jumps. Such decision processes were recentlyintroduced and studied from discrete time approximations point of view by Van der Duyn Schouten.Weobtain necessary and sufficient optimality conditions for these decision ...
openaire   +1 more source

Continuous‐time markov decision processes with nonzero terminal reward

Naval Research Logistics Quarterly, 1984
AbstractIn this article we consider a continuous‐time Markov decision process with a denumerable state space and nonzero terminal rewards. We first establish the necessary and sufficient optimality condition without any restriction on the cost functions.
openaire   +2 more sources

Continuous-Time Markov Decision Processes with State-Dependent Discount Factors

Acta Applicandae Mathematicae, 2012
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Ye, Liuer, Guo, Xianping
openaire   +2 more sources

Mean–semivariance optimality for continuous-time Markov decision processes

Systems & Control Letters, 2019
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
openaire   +1 more source

Continuous-Time Markov Decision Processes

2014
In this chapter, we review the fundamentals of continuous-time Markov decision processes (CTMDPs) as used in this thesis. Our focus is on CTMDPs as the problems presented in Chap. 2 are considered in continuous time. In Sect. 4.1, we outline the general structure of a CTMDP.
openaire   +1 more source

Bias optimality for multichain continuous-time Markov decision processes

Operations Research Letters, 2009
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Guo, Xianping, Song, Xinyuan, Zhang, Junyu   +2 more
openaire   +1 more source

Constrained continuous-time Markov decision processes with average criteria

Mathematical Methods of Operations Research, 2007
Constrained continuous-time Markov decision processes with a denumerable state space and unbounded reward/cost and transition rates are studied. The criterion to be maximized is the expected average reward, and a constraint is imposed on an expected average cost.
Zhang, Lanlan, Guo, Xianping
openaire   +1 more source