Results 131 to 140 of about 1,517,214 (350)

Controlling Tracking Performance for System Health Management - A Markov Decision Process Formulation

open access: yesInternational Journal of Prognostics and Health Management, 2015
After an incipient fault mode has been detected a logical question to ask is: How long can the system continue to be operated before the incipient fault mode degrades to a failure condition?
Brian Bole   +2 more
doaj   +1 more source

Cascade Markov Decision Processes: Theory and Applications [PDF]

open access: yesarXiv, 2015
This paper considers the optimal control of time varying continuous time Markov chains whose transition rates are themselves Markov processes. In one set of problems the solution of an ordinary differential equation is shown to determine the optimal performance and feedback controls, while some other cases are shown to lead to singular optimal control ...
arxiv  

An axiomatic approach to Markov decision processes

open access: yesMathematical Methods of Operations Research, 2022
AbstractThis paper presents an axiomatic approach to finite Markov decision processes where the discount rate is zero. One of the principal difficulties in the no discounting case is that, even if attention is restricted to stationary policies, a strong overtaking optimal policy need not exists.
openaire   +3 more sources

Massively parallel computation of globally optimal shortest paths with curvature penalization

open access: yesConcurrency and Computation: Practice and Experience, Volume 35, Issue 2, 25 January 2023., 2023
Abstract We address the computation of paths globally minimizing an energy involving their curvature, with given endpoints and tangents at these endpoints, according to models known as the Reeds‐Shepp car (reversible and forward variants), the Euler‐Mumford elasticae, and the Dubins car. For that purpose, we numerically solve degenerate variants of the
Jean‐Marie Mirebeau   +4 more
wiley   +1 more source

User in the Loop: Adaptive Smart Homes Exploiting User Feedback—State of the Art and Future Directions

open access: yesInformation, 2016
Due to the decrease of sensor and actuator prices and their ease of installation, smart homes and smart environments are more and more exploited in automation and health applications.
Abir B. Karami   +3 more
doaj   +1 more source

Information Relaxation and Dual Formulation of Controlled Markov Diffusions [PDF]

open access: yesarXiv, 2013
Information relaxation and duality in Markov decision processes have been studied recently by several researchers with the goal to derive dual bounds on the value function. In this paper we extend this dual formulation to controlled Markov diffusions: in a similar way we relax the constraint that the decision should be made based on the current ...
arxiv  

Home - About - Disclaimer - Privacy