SEMI-MARKOV DECISION PROCESSES AND THEIR APPLICATIONS IN REPLACEMENT MODELS
Journal of the Operations Research Society of Japan, 1985 We consider the problem of minimizing the long-run average expected cost per unit time in a semi-Markov decision process with arbitrary state and action space. Using the idea of successive approximations, sufficient conditions for the existence of an optimal stationary policy are given.
openaire +3 more sources
Manufacturer - Wholesaler System Study Based on Markov Decision Process [PDF]
Economic efficiency of trading and manufacturing enterprises is conditioned by a variety of reasons one of them being a proper pricing policy. Besides cost price, sale/demand correlation and marketing tactics many other factors that cannot be fully ...
Čižovs, Jurijs +2 more
core
A Semi-Markov framework for modeling football possessions and temporal expected threat
Scientific ReportsThis study presents a spatio-temporal semi-Markov framework to model football possessions and evaluate scoring probability within specific time windows.
Sebastian Le Coz +2 more
doaj +1 more source
Markov Decision Process in the Problem of Dynamic Pricing Policy [PDF]
Markov decision processes (MDP) are widely used in problems whose solutions may be represented by a certain series of actions. A lot of papers demonstrate successful MDP use in model problems, robotic control problems, planning problems, etc. In addition,
Čižovs, Jurijs, Borisovs, Arkādijs
core
Adaptive Computing Resource Allocation for Mobile Cloud Computing
International Journal of Distributed Sensor Networks, 2013 Mobile cloud computing (MCC) enables mobile devices to outsource their computing, storage and other tasks onto the cloud to achieve more capacities and higher performance.
Hongbin Liang +5 more
doaj +1 more source
A policy gradient method for semi-Markov decision processes [PDF]
, 2002 Solving a semi-Markov decision process (SMDP) using value or policy iteration requires precise knowledge of the probabilistic model and suffers from the curse of dimensionality.
Sumeetpal S. Singh +2 more
core
A multicriteria competitive Markov decision process [PDF]
, 2021 The course work is devoted to A multicriteria competitive Markov decision process; proposed software implementation of their solution. The work consists of an introduction, the main part that consists of six sections, a conclusion, a list of used ...
Левченко, Іларія
core +1 more source
Wide sense one-dependent processes with embedded Harris chains and their applications in inventory management [PDF]
In this paper we consider stochastic processes with an embedded Harris chain. The embedded Harris chain describes the dependence structure of the stochastic process.
Bazsa, E.M., Iseger, P. den
core +1 more source
Decision problem for a finite states change of semi-Markov process [PDF]
, 2015 In the paper there are presented basic concepts and some results of the theory of semi-Markov decision processes. The algorithm of optimization a SM decision process with a finite number of state changes is discussed here.
Grabski, F.
core
Multi-State Models for Panel Data: The msm Package for R [PDF]
Panel data are observations of a continuous-time process at arbitrary times, for example, visits to a hospital to diagnose disease status. Multi-state models for such data are generally based on the Markov assumption.
Christopher Jackson
core +1 more source