Beam scheduling for electronically scanned array tracking systems using multi-arm bandits

TitleBeam scheduling for electronically scanned array tracking systems using multi-arm bandits
Publication TypeConference Paper
Year of Publication1999
AuthorsKrishnamurthy, V., J. Mickova, and R. J. Evans
Conference NameDecision and Control, 1999. Proceedings of the 38th IEEE Conference on
Pagination1039 -1044 vol.1
Keywordsbeam scheduling, decision theory, dynamic programming, electronically scanned array tracking systems, finite dimensional optimal solution, game theory, Gittins index, hidden Markov models, multi-arm bandits, scheduling problem, state estimation, target tracking
Abstract

We derive optimal and sub-optimal beam scheduling algorithms for electronically scanned array tracking systems. We formulate the scheduling problem as a multi-arm bandit problem involving hidden Markov models. A finite dimensional optimal solution to this multi-arm bandit problem is presented. The key to solving any multi-arm bandit problem is to compute the Gittins index. We present, a finite dimensional algorithm which computes the Gittins index. Suboptimal algorithms for computing the Gittins index are also presented

URLhttp://dx.doi.org/10.1109/CDC.1999.832932
DOI10.1109/CDC.1999.832932

a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949
Email:

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2020 The University of British Columbia