POMDP multi-armed bandit formulation for energy minimization in sensor networks

TitlePOMDP multi-armed bandit formulation for energy minimization in sensor networks
Publication TypeConference Paper
Year of Publication2005
AuthorsKrishnamurthy, V.
Conference NameAcoustics, Speech, and Signal Processing, 2005. Proceedings. (ICASSP '05). IEEE International Conference on
Paginationv/793 - v/796 Vol. 5
Date Publishedmar.
Keywordsactive sensor platforms, combat system vulnerability, distributed sensors, electronic warfare, enemy surveillance sensors, low probability of intercept, LPI, Markov processes, military communication, military equipment, military radar, minimisation, multiple networked heterogenous sensors, multiple-armed bandit formulation, network centric warfare, partially observed Markov decision process, POMDP, radar, sensor emission energy dynamic control, sensor management algorithms, sensor network energy minimization, surveillance, threat minimization

In network centric warfare, sensor platforms with active sensing equipment such as radars can betray their existence, by emitting energy that can be intercepted by enemy surveillance sensors thereby increasing the vulnerability of the entire combat system. To achieve the important tactical requirement of low probability of intercept (LPI), requires dynamically controlling the emission energy of sensors. In this paper, we propose computationally efficient dynamic emission control and management algorithms for multiple networked heterogenous sensors. By formulating the problem as a partially observed Markov decision process (POMDP) with an on-going multi-armed bandit structure, near optimal sensor management algorithms are developed for controlling the active sensor emission to minimize the threat.


a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2021 The University of British Columbia