Optimality of Monotone Policies for Transmission Control with Switching Costs

TitleOptimality of Monotone Policies for Transmission Control with Switching Costs
Publication TypeConference Paper
Year of Publication2007
AuthorsFarrokh, A., and V. Krishnamurthy
Conference NameDecision and Control, 2007 46th IEEE Conference on
Pagination5222 -5227
Date Publisheddec.
Keywordschannel dependent delay cost, delays, finite state Markovian channel, infinite horizon Markov decision problem, Markov processes, optimal control, optimal transmission control rules, switching costs, time slotted transmission system, time-varying systems, transmission latency

This paper considers a time slotted transmission system over a finite state Markovian channel where in each time slot a transmission mode is dynamically selected from a finite set. There is a switching cost for changing the transmission mode and there is a channel dependent delay cost associated with each transmission mode. We formulate the optimal trade-off between the transmission latency (delay cost) and the mode switching cost as an infinite horizon Markov decision problem (MDP). By exploiting special structures of the formulated MDP and under certain sufficient conditions, we show that optimal transmission mode selection policies are monotone in the state variables. Furthermore, the transmission control exhibits more resistance to change the transmission mode as compared with the case with no switching cost. These monotone (threshold- based) structures allow efficient numerical solutions along with an improved qualitative assessment of optimal transmission control rules.


a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2021 The University of British Columbia