A Fast-Pivoting Algorithm for Whittle’s Restless Bandit Index
Mathematics, 2020 The Whittle index for restless bandits (two-action semi-Markov decision processes) provides an intuitively appealing optimal policy for controlling a single generic project that can be active (engaged) or passive (rested) at each decision epoch, and ...
José Niño-Mora
doaj +3 more sources
Non-Myopic Beam Scheduling for Multiple Smart-Target Tracking in Phased Array Radar Networks [PDF]
SensorsThis paper addresses beam scheduling for tracking multiple smart targets in phased array radar networks, aiming to mitigate the performance degradation in previous myopic scheduling methods and enhance the tracking performance, which is measured by a ...
Yuhang Hao +5 more
doaj +2 more sources
A Whittle Index Approach to Minimizing Age of Multi-Packet Information in IoT Network
IEEE Access, 2021 Age of information (AoI) captures the freshness of information and has been used broadly as an important performance metric in big data analytics in the Internet of Things (IoT).
Mianlong Chen, Kui Wu, Linqi Song
doaj +1 more source
Long range dependency and forecasting of housing price index and mortgage market rate: evidence of subprime crisis [PDF]
Management Science Letters, 2015 In this paper, we examine and forecast the House Price Index (HPI) and mortgage market rate in terms of the description of the subprime crisis. We use a semi-parametric local polynomial Whittle estimator proposed by Shimotsu et al. (2005) [Shimotsu, K., &
Nadhem Selmi, Nejib Hachicha
doaj +1 more source
Mathematics, 2023 Over the last decade, the Age of Information has emerged as a key concept and metric for applications where the freshness of sensor-provided data is critical.
José Niño-Mora
doaj +1 more source
Markovian Restless Bandits and Index Policies: A Review
Mathematics, 2023 The restless multi-armed bandit problem is a paradigmatic modeling framework for optimal dynamic priority allocation in stochastic models of wide-ranging applications that has been widely investigated and applied since its inception in a seminal paper by
José Niño-Mora
doaj +1 more source
Fast Two-Stage Computation of an Index Policy for Multi-Armed Bandits with Setup Delays
Mathematics, 2020 We consider the multi-armed bandit problem with penalties for switching that include setup delays and costs, extending the former results of the author for the special case with no switching delays.
José Niño-Mora
doaj +1 more source
Deep Reinforcement Learning Heterogeneous Channels for Poisson Multiple Access
Mathematics, 2023 This paper proposes a medium access control (MAC) protocol based on deep reinforcement learning (DRL), i.e., multi-channel transmit deep-reinforcement learning multi-channel access (MCT-DLMA) in heterogeneous wireless networks (HetNets).
Xu Zhang +3 more
doaj +1 more source
A Novel Scheduling Index Rule Proposal for QoE Maximization in Wireless Networks
Abstract and Applied Analysis, 2014 This paper deals with the resource allocation problem aimed at maximizing users’ perception of quality in wireless channels with time-varying capacity. First of all, we model the subjective quality-aware scheduling problem in the framework of Markovian ...
Ianire Taboada, Fidel Liberal
doaj +1 more source
Adaptive Scheduling: A Reinforcement Learning Whittle Index Approach for Wireless Sensor Networks
IEEE AccessWe propose a Reinforcement Learning (RL)-based scheduling framework for Restless Multi-Armed Bandit (RMAB) problems, centred on a Whittle Index Q-Learning policy with Upper Confidence Bound (Whittle index Q-Learning (WIQL)-upper confidence bound (UCB ...
Sokipriala Jonah +2 more
doaj +1 more source