Results 1 to 10 of about 97 (94)

Markovian Restless Bandits and Index Policies: A Review

Mathematics, 2023
The restless multi-armed bandit problem is a paradigmatic modeling framework for optimal dynamic priority allocation in stochastic models of wide-ranging applications that has been widely investigated and applied since its inception in a seminal paper by
JOSÉ Niño-Mora
exaly   +3 more sources

Rested and Restless Bandits With Constrained Arms and Hidden States: Applications in Social Networks and 5G Networks

IEEE Access, 2018
The problem of rested and restless multi-armed bandits with constrained availability (RMAB-CA) of arms is considered. The states of arms evolve in Markovian manner and the exact states are hidden from the decision maker. First, some structural results on
Varun Mehta, Kesav Kaza, S N Merchant
exaly   +3 more sources

A Whittle Index Approach to Minimizing Age of Multi-Packet Information in IoT Network

IEEE Access, 2021
Age of information (AoI) captures the freshness of information and has been used broadly as an important performance metric in big data analytics in the Internet of Things (IoT).
Mianlong Chen, Kui Wu, Linqi Song
doaj   +1 more source

Distributed learning algorithm with synchronized epochs for dynamic spectrum access in unknown environment using multi-user restless multi-armed bandit

Journal of King Saud University: Computer and Information Sciences, 2022
Dynamic spectrum access using cognitive radio has many application areas like smart-grid, Internet of Things, and various other device-to-device communication paradigms.
Himanshu Agrawal, Krishna Asawa
doaj   +1 more source

A Fast-Pivoting Algorithm for Whittle’s Restless Bandit Index

Mathematics, 2020
The Whittle index for restless bandits (two-action semi-Markov decision processes) provides an intuitively appealing optimal policy for controlling a single generic project that can be active (engaged) or passive (rested) at each decision epoch, and ...
José Niño-Mora
doaj   +1 more source

Restless Video Bandits: Optimal SVC Streaming in a Multi-User Wireless Network

IEEE Access, 2019
In this paper, we consider the problem of optimal scalable video delivery to mobile users in wireless networks given arbitrary Quality Adaptation (QA) mechanisms.
S. Amir Hosseini, Shivendra S. Panwar
doaj   +1 more source

Constrained Restless Bandits for Dynamic Scheduling in Cyber-Physical Systems

IEEE Access
This paper develops a sequential decision-making framework called constrained restless multi-armed bandits (CRMABs) to model problems of resource allocation under uncertainty and dynamic availability constraints.
Kesav Ram Kaza, Rahul H. Meshram, Varunkumar Mehta, Shabbir N. Merchant   +3 more
doaj   +1 more source

Non-Myopic Beam Scheduling for Multiple Smart-Target Tracking in Phased Array Radar Networks

Sensors
This paper addresses beam scheduling for tracking multiple smart targets in phased array radar networks, aiming to mitigate the performance degradation in previous myopic scheduling methods and enhance the tracking performance, which is measured by a ...
Yuhang Hao, Zengfu Wang, José Niño-Mora, Jing Fu, Quan Pan, Min Yang   +5 more
doaj   +1 more source

Design of Centralized Scheduling Policies for Minimizing Average Age of Incorrect Information in Multi-Hop Wireless Networks With Interference

IEEE Access
This paper designs and evaluates novel centralized sampling and scheduling policies for minimizing the average age of incorrect information (AoII) for a multi-hop network with interference constraints.
Nibin Raj, Vineeth Bala Sukumaran
doaj   +1 more source

Multi-Armed Bandits in Brain-Computer Interfaces. [PDF]

Front Hum Neurosci, 2022
Heskebeck F, Bergeling C, Bernhardsson B.   +2 more
europepmc   +1 more source