On Optimality of Monotone Channel-Aware Transmission Policies: A Constrained Markov Decision Process Approach

TitleOn Optimality of Monotone Channel-Aware Transmission Policies: A Constrained Markov Decision Process Approach
Publication TypeConference Paper
Year of Publication2007
AuthorsNgo, M. H., and V. Krishnamurthy
Conference NameAcoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on
PaginationIII-621 -III-624
Date Publishedapr.
Keywordsaverage delay constraint, average transmission energy cost, buffer occupancy, channel state information, constrained Markov decision process approach, fading channels, fading wireless channel correlation, Lagrange multiplier method, Markov processes, monotone channel-aware transmission policies, packet transmission, transmission policy
Abstract

A constrained Markov decision process (MDP) approach is deployed to prove the monotone structure of optimal channel-aware transmission policies for packet transmission over a correlated fading wireless channel subject to an average delay constraint. A transmission policy is a function mapping channel state information (CSI), buffer states and numbers of arriving packets to transmit probabilities. The objective is to minimize the average transmission energy cost subject to an average delay constraint. We use the Lagrange multiplier method to convert the constrained MDP to an unconstrained MDP and prove that the unconstrained optimal policy is threshold in the buffer state. It then follows that the constrained optimal transmission policy is a randomized mixture of two pure transmission policies that are threshold in the buffer occupancy

URLhttp://dx.doi.org/10.1109/ICASSP.2007.366756
DOI10.1109/ICASSP.2007.366756

a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949
Email:

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2020 The University of British Columbia