Timed Comparisons of Semi-Markov Processes [PDF]
, 2017 Semi-Markov processes are Markovian processes in which the firing time of the transitions is modelled by probabilistic distributions over positive reals interpreted as the probability of firing a transition at a certain moment in time.
Bacci, Giorgio +4 more
core +2 more sources
Cost rate heuristics for semi-Markov decision processes
Journal of Applied Probability, 1992 In response to the computational complexity of the dynamic programming/backwards induction approach to the development of optimal policies for semi-Markov decision processes, we propose a class of heuristics resulting from an inductive process which proceeds forwards in time.
Glazebrook, K.D. +2 more
openaire +3 more sources
Radio Resource Allocation in 5G-NR V2X: A Multi-Agent Actor-Critic Based Approach
IEEE Access, 2023 The efficiency of radio resource allocation and scheduling procedures in Cellular Vehicle-to-X (Cellular V2X) communication networks directly affects link quality in terms of latency and reliability. However, owing to the continuous movement of vehicles,
Anupama Hegde, Rui Song, Andreas Festag
doaj +1 more source
Semi-Markov decision process based congestion control algorithm for video transmission
Tongxin xuebao, 2014 Due to the problem that the congestion control algorithm of transmission control protocol (TCP) cannot meet the requirements of quality of experience for Internet video transmission, a semi-Markov decision process based conges-tion control algorithm for ...
Bo TIAN, Yi-min YANG, Shu-ting CAI
doaj +2 more sources
Exponential stabilization of a class of stochastic system with Markovian jump parameters and mode-dependent mixed time-delays [PDF]
, 2010 Copyright [2010] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services.
Liu, X, Liu, Y, Wang, Z
core +2 more sources
QoS Differentiated and Fair Packet Scheduling in Broadband Wireless Access Networks
EURASIP Journal on Wireless Communications and Networking, 2009 This paper studies the packet scheduling problem in Broadband Wireless Access (BWA) networks. The key difficulties of the BWA scheduling problem lie in the high variability of wireless channel capacity and the unknown model of packet arrival process.
Yan Zhang, Shengli Xie, Rong Yu
doaj +2 more sources
Learning Evolutionary Stages with Hidden Semi-Markov Model for Predicting Social Unrest Events
Discrete Dynamics in Nature and Society, 2020 Social unrest events are common happenings in modern society which need to be proactively handled. An effective method is to continuously assess the risk of upcoming social unrest events and predict the likelihood of these events. Our previous work built
Fengcai Qiao, Xin Zhang, Jinsheng Deng
doaj +1 more source
Scheduling Strategy Design Framework for Cyber–Physical System with Non-Negligible Propagation Delay
Entropy, 2021 Cyber–physical systems (CPS) have been widely employed as wireless control networks. There is a special type of CPS which is developed from the wireless networked control systems (WNCS).
Zuoyu An +4 more
doaj +1 more source
Average optimality for continuous-time Markov decision processes under weak continuity conditions
, 2014 This article considers the average optimality for a continuous-time Markov decision process with Borel state and action spaces and an arbitrarily unbounded nonnegative cost rate.
Zhang, Yi
core +1 more source
Environmental boundary tracking and estimation using multiple autonomous vehicles [PDF]
, 2008 In this paper, we develop a framework for environmental boundary tracking and estimation by considering the boundary as a hidden Markov model (HMM) with separated observations collected from multiple sensing vehicles.
Bertozzi, Andrea L., Jin, Zhipu
core +1 more source