On gradual-impulse control of continuous-time Markov decision processes with multiplicative cost
, 2018 In this paper, we consider the gradual-impulse control problem of continuous-time Markov decision processes, where the system performance is measured by the expectation of the exponential utility of the total cost. We prove, under very general conditions
Guo, Xin +3 more
core
On the Practical Art of State Definitions for Markov Decision Process Construction
IEEE Access, 2018 Many problems faced by decision makers today involve the management of large scale, complex systems that can be modeled as state-based control problems, specifically discrete Markov decision process (MDP). Typical examples include transportation systems,
William T. Scherer +2 more
doaj +1 more source
Novel Data Transmission Schemes for Inter-WBAN Networks Using Markov Decision Process. [PDF]
Wirel Pers Commun, 2023 Roy S, Roy M, Chowdhury C.
europepmc +1 more source
Stochastic energy management of DC photovoltaic microgrids using Markov decision process
Results in EngineeringThe increasing reliance on renewable energy sources, particularly photovoltaic (PV) systems, in off-grid applications presents a critical challenge: managing energy supply under random load behavior and intermittent resource availability.
Mohamed Aatabe +3 more
doaj +1 more source
Safe Reinforcement Learning for Arm Manipulation with Constrained Markov Decision Process
RoboticsIn the world of human–robot coexistence, ensuring safe interactions is crucial. Traditional logic-based methods often lack the intuition required for robots, particularly in complex environments where these methods fail to account for all possible ...
Patrick Adjei +3 more
doaj +1 more source
A Promising Approach to Optimizing Sequential Treatment Decisions for Depression: Markov Decision Process. [PDF]
Pharmacoeconomics, 2022 Li F, Jörg F, Li X, Feenstra T.
europepmc +1 more source
International Journal of Prognostics and Health Management, 2015 After an incipient fault mode has been detected a logical question to ask is: How long can the system continue to be operated before the incipient fault mode degrades to a failure condition?
Brian Bole +2 more
doaj +1 more source
Author Correction: Improving RED algorithm congestion control by using the Markov decision process. [PDF]
Sci Rep, 2022 Mahawish A, Hassan HJ.
europepmc +1 more source
OPTIMAL POLICIES FOR DISCRETE TIME RISK PROCESSES WITH A MARKOV CHAIN INVESTMENT MODEL [PDF]
We consider a discrete risk process modelled by a Markov Decision Process. The surplus could be invested in stock market assets. We adopt a realistic point of view and we let the investment return process to be statistically dependent over time.
Maikol Diasparra, Rosario Romera
core
Modeling eye movement in dynamic interactive tasks for maximizing situation awareness based on Markov decision process. [PDF]
Sci Rep, 2022 Ma S, Guo J, Zeng S, Che H, Pan X.
europepmc +1 more source