Risk-Sensitive Markov Decision Processes of USV Trajectory Planning with Time-Limited Budget
Sensors, 2023 Trajectory planning plays a crucial role in ensuring the safe navigation of ships, as it involves complex decision making influenced by various factors. This paper presents a heuristic algorithm, named the Markov decision process Heuristic Algorithm (MHA)
Yi Ding, Hongyang Zhu
doaj +1 more source
Configurable Markov Decision Processes
CoRR, 2018 In many real-world problems, there is the possibility to configure, to a limited extent, some environmental parameters to improve the performance of a learning agent. In this paper, we propose a novel framework, Configurable Markov Decision Processes (Conf-MDPs), to model this new type of interaction with the environment.
Metelli, Alberto Maria +2 more
openaire +6 more sources
Recursive Markov Decision Processes and Recursive Stochastic Games [PDF]
, 2005 We introduce Recursive Markov Decision Processes (RMDPs) and Recursive Simple Stochastic Games (RSSGs), and study the decidability and complexity of algorithms for their analysis and verification.
Mihalis Yannakakis +3 more
core +1 more source
Intelligent Sensing in Dynamic Environments Using Markov Decision Process
Sensors, 2011 In a network of low-powered wireless sensors, it is essential to capture as many environmental events as possible while still preserving the battery life of the sensor node. This paper focuses on a real-time learning algorithm to extend the lifetime of a
Asad M. Madni +3 more
doaj +1 more source
Automatic Horizon Picking Using Multiple Seismic Attributes and Markov Decision Process
Remote Sensing, 2023 Picking the reflection horizon is an important step in velocity inversion and seismic interpretation. Manual picking is time-consuming and no longer suitable for current large-scale seismic data processing.
Chengliang Wu +5 more
doaj +1 more source
Symbolic Magnifying Lens Abstraction in Markov Decision Processes [PDF]
, 2008 In this paper, we combine abstraction-refinement and symbolic techniques to fight the state-space explosion problem when model checking Markov decision processes (MDPs).
Luca de Alfaro +7 more
core +1 more source
Transportation infrastructure asset management modeling using Markov decision process under epistemic uncertainties [PDF]
Smart and Resilient Transportation, 2021 Purpose – Transportation infrastructure asset management has long been an active but challenging problem for agencies, which urges to maintain a good state of their assets but faces budgetary limitations.
Yun Bai, Saeed Babanajad, Zheyong Bian
doaj +1 more source
The complexity of synchronizing Markov decision processes [PDF]
Journal of Computer and System Sciences, 2019 arXiv admin note: substantial text overlap with arXiv:1402.2840, arXiv:1310 ...
Laurent Doyen 0001 +2 more
openaire +5 more sources
Reachability in Recursive Markov Decision Processes [PDF]
Information and Computation, 2006 A class of infinite-state Markov decision processes generated by stateless pushdown automata is considered. This class corresponds to 1 1/2-player games over graphs generated by BPA systems or (equivalently) 1-exit recursive state machines. An extended reachability objective is specified by two sets \(S\) and \(T\) of safe and terminal stack ...
Tomás Brázdil +3 more
openaire +4 more sources
An Approach to Customer Behavior Modeling using Markov Decision Process
Mendel, 2017 This paper presents an application of Markov Decision Process method for modeling of selected marketing processes. Based on available realistic data, MDP model is constructed. Customer behavior is represented by a set of states of the model with assigned
Ondrej Grunt +4 more
doaj +1 more source