Markov Decision Process for Video Generation [PDF]
We identify two pathological cases of temporal inconsistencies in video generation: video freezing and video looping. To better quantify the temporal diversity, we propose a class of complementary metrics that are effective, easy to implement, data ...
V. Yushchenko, Nikita Araslanov, S. Roth
semanticscholar +1 more source
Dynamic Service Migration in Mobile Edge Computing Based on Markov Decision Process
In mobile edge computing, local edge servers can host cloud-based services, which reduces network overhead and latency but requires service migrations as users move to new locations.
Shiqiang Wang +5 more
semanticscholar +1 more source
With the rapid development of electric vehicles (EVs), the dramatic rise in the demand for electricity is creating heavy pressure on local grids. The combination of renewable energy and EV charging stations (EVCSs) provides a promising solution for ...
Yuehua Wu +5 more
semanticscholar +1 more source
CAPIR: Collaborative Action Planning with Intention Recognition [PDF]
We apply decision theoretic techniques to construct non-player characters that are able to assist a human player in collaborative games. The method is based on solving Markov decision processes, which can be difficult when the game state is described by ...
Grant, Andrew Haydn +6 more
core +6 more sources
Cost-Bounded Active Classification Using Partially Observable Markov Decision Processes [PDF]
Active classification, i.e., the sequential decision-making process aimed at data acquisition for classification purposes, arises naturally in many applications, including medical diagnosis, intrusion detection, and object tracking.
Ahmadi, Mohamadreza +3 more
core +2 more sources
Risk-Sensitive Markov Decision Processes of USV Trajectory Planning with Time-Limited Budget
Trajectory planning plays a crucial role in ensuring the safe navigation of ships, as it involves complex decision making influenced by various factors. This paper presents a heuristic algorithm, named the Markov decision process Heuristic Algorithm (MHA)
Yi Ding, Hongyang Zhu
doaj +1 more source
Partially Observable Markov Decision Processes in Robotics: A Survey [PDF]
Noisy sensing, imperfect control, and environment changes are defining characteristics of many real-world robot tasks. The partially observable Markov decision process (POMDP) provides a principled mathematical framework for modeling and solving robot ...
M. Lauri, David Hsu, J. Pajarinen
semanticscholar +1 more source
Automatic Horizon Picking Using Multiple Seismic Attributes and Markov Decision Process
Picking the reflection horizon is an important step in velocity inversion and seismic interpretation. Manual picking is time-consuming and no longer suitable for current large-scale seismic data processing.
Chengliang Wu +5 more
doaj +1 more source
A reinforcement learning based decision support system in textile manufacturing process
This paper introduced a reinforcement learning based decision support system in textile manufacturing process. A solution optimization problem of color fading ozonation is discussed and set up as a Markov Decision Process (MDP) in terms of tuple {S, A, P,
He, Zhenglei +4 more
core +1 more source
Transportation infrastructure asset management modeling using Markov decision process under epistemic uncertainties [PDF]
Purpose – Transportation infrastructure asset management has long been an active but challenging problem for agencies, which urges to maintain a good state of their assets but faces budgetary limitations.
Yun Bai, Saeed Babanajad, Zheyong Bian
doaj +1 more source

