Results 101 to 110 of about 709,572 (229)

A Mixed Observability Markov Decision Process Model for Musical Pitch [PDF]

open access: yesarXiv, 2012
Partially observable Markov decision processes have been widely used to provide models for real-world decision making problems. In this paper, we will provide a method in which a slightly different version of them called Mixed observability Markov decision process, MOMDP, is going to join with our problem.
arxiv  

Stochastic Capital Depreciation and the Comovement of Hours and Productivity [PDF]

open access: yes
In this article, we demonstrate that a small degree of stochastic variation in the depreciation rate of capital can greatly reduce the comovement between hours worked and labor productivity in a neoclassical growth model. The depreciation rate is modeled
Andreas Fischer   +2 more
core  

An axiomatic approach to Markov decision processes

open access: yesMathematical Methods of Operations Research, 2022
AbstractThis paper presents an axiomatic approach to finite Markov decision processes where the discount rate is zero. One of the principal difficulties in the no discounting case is that, even if attention is restricted to stationary policies, a strong overtaking optimal policy need not exists.
openaire   +3 more sources

Controlling Tracking Performance for System Health Management - A Markov Decision Process Formulation

open access: yesInternational Journal of Prognostics and Health Management, 2015
After an incipient fault mode has been detected a logical question to ask is: How long can the system continue to be operated before the incipient fault mode degrades to a failure condition?
Brian Bole   +2 more
doaj   +1 more source

Cascade Markov Decision Processes: Theory and Applications [PDF]

open access: yesarXiv, 2015
This paper considers the optimal control of time varying continuous time Markov chains whose transition rates are themselves Markov processes. In one set of problems the solution of an ordinary differential equation is shown to determine the optimal performance and feedback controls, while some other cases are shown to lead to singular optimal control ...
arxiv  

Information Relaxation and Dual Formulation of Controlled Markov Diffusions [PDF]

open access: yesarXiv, 2013
Information relaxation and duality in Markov decision processes have been studied recently by several researchers with the goal to derive dual bounds on the value function. In this paper we extend this dual formulation to controlled Markov diffusions: in a similar way we relax the constraint that the decision should be made based on the current ...
arxiv  

Home - About - Disclaimer - Privacy