Results 21 to 30 of about 1,517,115 (252)
Bounding the Difference between the Values of Robust and Non-Robust Markov Decision Problems [PDF]
J. Appl. Probab. 62 (2025) 558-571, 2023 In this note we provide an upper bound for the difference between the value function of a distributionally robust Markov decision problem and the value function of a non-robust Markov decision problem, where the ambiguity set of probability kernels of the distributionally robust Markov decision process is described by a Wasserstein-ball around some ...
arxiv +1 more source
IEEE transactions on industry applications, 2020 Electric vehicles (EVs) have rapidly developed in recent years and their penetration has also significantly increased, which, however, brings new challenges to power systems. Due to their stochastic behaviors, the improper charging strategies for EVs may
Tao Ding +5 more
semanticscholar +1 more source
Complexity, 2021 Cognitive searching optimization is a subconscious mental phenomenon in decision making. Aroused by exploiting accessible human action, alleviating inefficient decision and shrinking searching space remain challenges for optimizing the solution space ...
Bingxuan Ren, Tangwen Yin, Shan Fu
doaj +1 more source
Markov Decision Process for Video Generation [PDF]
2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), 2019 We identify two pathological cases of temporal inconsistencies in video generation: video freezing and video looping. To better quantify the temporal diversity, we propose a class of complementary metrics that are effective, easy to implement, data ...
V. Yushchenko, Nikita Araslanov, S. Roth
semanticscholar +1 more source
Health Status-Based Predictive Maintenance Decision-Making via LSTM and Markov Decision Process
Mathematics, 2022 Maintenance decision-making is essential to achieve safe and reliable operation with high performance for equipment. To avoid unexpected shutdown and increase machine life as well as system efficiency, it is fundamental to design an effective maintenance
Pan Zheng +4 more
doaj +1 more source
Partially Observable Markov Decision Processes in Robotics: A Survey [PDF]
IEEE Transactions on robotics, 2022 Noisy sensing, imperfect control, and environment changes are defining characteristics of many real-world robot tasks. The partially observable Markov decision process (POMDP) provides a principled mathematical framework for modeling and solving robot ...
M. Lauri, David Hsu, J. Pajarinen
semanticscholar +1 more source
Risk-Sensitive Markov Decision Processes of USV Trajectory Planning with Time-Limited Budget
Sensors, 2023 Trajectory planning plays a crucial role in ensuring the safe navigation of ships, as it involves complex decision making influenced by various factors. This paper presents a heuristic algorithm, named the Markov decision process Heuristic Algorithm (MHA)
Yi Ding, Hongyang Zhu
doaj +1 more source
Dynamic virtual machine management via approximate Markov decision process [PDF]
IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications, 2016 Efficient virtual machine (VM) management can dramatically reduce energy consumption in data centers. Existing VM management algorithms fall into two categories based on whether the VMs' resource demands are assumed to be static or dynamic.
Zhenhua Han +5 more
semanticscholar +1 more source
Aerospace, 2023 Current electronic warfare jammers and radar countermeasures are characterized by dynamism and uncertainty. This paper focuses on a decision-making framework of radar anti-jamming countermeasures.
Huaixi Xing, Qinghua Xing, Kun Wang
doaj +1 more source
Transportation infrastructure asset management modeling using Markov decision process under epistemic uncertainties [PDF]
Smart and Resilient Transportation, 2021 Purpose – Transportation infrastructure asset management has long been an active but challenging problem for agencies, which urges to maintain a good state of their assets but faces budgetary limitations.
Yun Bai, Saeed Babanajad, Zheyong Bian
doaj +1 more source