Cost rate heuristics for semi-Markov decision processes
Journal of Applied Probability, 1992 In response to the computational complexity of the dynamic programming/backwards induction approach to the development of optimal policies for semi-Markov decision processes, we propose a class of heuristics resulting from an inductive process which proceeds forwards in time.
Glazebrook, K.D. +2 more
openaire +3 more sources
Semi-Markov decision process based congestion control algorithm for video transmission
Tongxin xuebao, 2014 Due to the problem that the congestion control algorithm of transmission control protocol (TCP) cannot meet the requirements of quality of experience for Internet video transmission, a semi-Markov decision process based conges-tion control algorithm for ...
Bo TIAN, Yi-min YANG, Shu-ting CAI
doaj +2 more sources
Radio Resource Allocation in 5G-NR V2X: A Multi-Agent Actor-Critic Based Approach
IEEE Access, 2023 The efficiency of radio resource allocation and scheduling procedures in Cellular Vehicle-to-X (Cellular V2X) communication networks directly affects link quality in terms of latency and reliability. However, owing to the continuous movement of vehicles,
Anupama Hegde, Rui Song, Andreas Festag
doaj +1 more source
Average optimality for continuous-time Markov decision processes under weak continuity conditions
, 2014 This article considers the average optimality for a continuous-time Markov decision process with Borel state and action spaces and an arbitrarily unbounded nonnegative cost rate.
Zhang, Yi
core +1 more source
QoS Differentiated and Fair Packet Scheduling in Broadband Wireless Access Networks
EURASIP Journal on Wireless Communications and Networking, 2009 This paper studies the packet scheduling problem in Broadband Wireless Access (BWA) networks. The key difficulties of the BWA scheduling problem lie in the high variability of wireless channel capacity and the unknown model of packet arrival process.
Yan Zhang, Shengli Xie, Rong Yu
doaj +2 more sources
Learning Evolutionary Stages with Hidden Semi-Markov Model for Predicting Social Unrest Events
Discrete Dynamics in Nature and Society, 2020 Social unrest events are common happenings in modern society which need to be proactively handled. An effective method is to continuously assess the risk of upcoming social unrest events and predict the likelihood of these events. Our previous work built
Fengcai Qiao, Xin Zhang, Jinsheng Deng
doaj +1 more source
Scheduling Strategy Design Framework for Cyber–Physical System with Non-Negligible Propagation Delay
Entropy, 2021 Cyber–physical systems (CPS) have been widely employed as wireless control networks. There is a special type of CPS which is developed from the wireless networked control systems (WNCS).
Zuoyu An +4 more
doaj +1 more source
Learning to maximize reward rate: a model based on semi-Markov decision processes
Frontiers in Neuroscience, 2014 When animals have to make a number of decisions during a limited time interval, they face a fundamental problem: how much time they should spend on each decision in order to achieve the maximum possible total outcome.
Arash eKhodadadi +2 more
doaj +1 more source
Improving Power and Resource Management in Heterogeneous Downlink OFDMA Networks
Information, 2020 In the past decade, low power consumption schemes have undergone degraded communication performance, where they fail to maintain the trade-off between the resource and power consumption.
Nalliyanna Goundar Veerappan Kousik +4 more
doaj +1 more source
Polish Maritime Research, 2017 This article deals with the modeling of the processes of operating both marine main and auxiliary engines. The paper presents a model of changes in operating conditions of ship’s internal combustion engine.
Landowski Bogdan +3 more
doaj +1 more source