Results 221 to 230 of about 3,394 (246)
Some of the next articles are maybe not open access.
Whittle Index for AoI-Aware Scheduling
2020 International Conference on COMmunication Systems & NETworkS (COMSNETS), 2020We consider a system consisting of multiple sensors that send updates to a monitoring station via a shared communication channel. The focus is on designing scheduling policies to minimize the time-average of the weighted sum of the Age-of-Information of the sensors.
Bejjipuram Sombabu +3 more
openaire +1 more source
IEEE Transactions on Information Theory, 2010 submitted to IEEE Transactions on Information ...
Keqin Liu, Qing Zhao
exaly +3 more sources
Whittle-indexability of the Cow Path Problem
Proceedings of the 2010 American Control Conference, 2010In this paper we consider the well-studied Cow Path Problem (CPP), an on-line search problem that is typically treated with competitive analysis. This paper uses an alternative approach, posing the problem as a Markov Decision Problem (MDP). Our technical contribution is to prove that when posed as an MDP, a slightly relaxed version of the problem is ...
Tom Temple, Emilio Frazzoli
openaire +1 more source
Whittle Index Policy for Multichannel Scheduling in Queueing Systems [PDF]
2019 IEEE International Symposium on Information Theory (ISIT), 2019 extended version of a paper submitted to a ...
Saad Kriouile, Mohamad Assaad
exaly +4 more sources
Conditions for indexability of restless bandits and an algorithm to compute Whittle index
Advances in Applied Probability, 2022AbstractRestless bandits are a class of sequential resource allocation problems concerned with allocating one or more resources among several alternative processes where the evolution of the processes depends on the resources allocated to them. Such models capture the fundamental trade-offs between exploration and exploitation.
Nima Akbarzadeh, Aditya Mahajan
openaire +1 more source
Whittle Index Based User Association in Dense Millimeter Wave Networks
IEEE Transactions on Vehicular TechnologyWe address the problem of user association in a dense millimeter wave (mmWave) network, in which each arriving user brings a file containing a random number of packets and each time slot is divided into multiple mini-slots. This problem is an instance of
Gaurav S Kasbekar, Vivek S Borkar
exaly +2 more sources
Restless bandits with controlled restarts: Indexability and computation of Whittle index
2019 IEEE 58th Conference on Decision and Control (CDC), 2019Motivated by applications in machine repair, queueing, surveillance, and clinic care, we consider a scheduling problem where a decision maker can reset m out of n Markov processes at each time. Processes that are reset, restart according to a known probability distribution and processes that are not reset, evolve in a Markovian manner.
Nima Akbarzadeh, Aditya Mahajan
exaly +2 more sources
A Whittle's Index Based Approach for QoE Optimization in Wireless Networks [PDF]
Proceedings of the ACM on Measurement and Analysis of Computing Systems, 2018 The design of schedulers to optimize heterogeneous users' Quality of Experience (QoE) remains a challenging and important problem for wireless systems. This paper explores three inter-related aspects of this problem: 1) non-linear relationships between a user's QoE and flow delays; 2) managing load dependent QoE trade-offs among heterogeneous ...
Gustavo De Veciana
exaly +3 more sources
Indexability and whittle index for restless bandit problems involving reset processes
IEEE Conference on Decision and Control and European Control Conference, 2011We consider a class of restless multi-armed bandit (RMAB) problems, in which the active action resets the stochastic evolution of the system. We obtain the Whittle index in closed-form, showing that it induces a policy that is equivalent to the myopic policy, and that it is optimal for stochastically identical arms.
Keqin Liu +2 more
openaire +1 more source
Advances in Applied Probability, 2023
Abstract This note corrects an error in the formula to obtain the Whittle index using the Sherman–Morrison formula in Akbarzadeh and Mahajan (2022). Also, some other minor typos are highlighted.
Nima Akbarzadeh, Aditya Mahajan
openaire +1 more source
Abstract This note corrects an error in the formula to obtain the Whittle index using the Sherman–Morrison formula in Akbarzadeh and Mahajan (2022). Also, some other minor typos are highlighted.
Nima Akbarzadeh, Aditya Mahajan
openaire +1 more source