Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning

TitleEfficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning
Publication TypeConference Paper
Year of Publication2004
AuthorsYu, F., V. W. S. Wong, and V. C. M. Leung
Conference NameBroadband Networks, 2004. BroadNets 2004. Proceedings. 1st International Conference on
Pagination579 - 588
Date Publishedoct.
Keywordsadaptive multimedia, adaptive multimedia service, bandwidth adaptation, bandwidth allocation, call admission control, constrained Markov decision, handoff dropping probability, learning (artificial intelligence), Markov processes, mobile communication network, mobile radio, multimedia communication, QoS provisioning, quality of service, reinforcement learning, state transition probability, telecommunication computing, telecommunication congestion control

The scarcity and large fluctuations of link bandwidth in wireless networks have motivated the development of adaptive multimedia services in mobile communication networks, where it is possible to increase or decrease the bandwidth of individual ongoing flows. This paper studies the issues of quality of service (QoS) provisioning in such systems. In particular, call admission control and bandwidth adaptation are formulated as a constrained Markov decision problem. The rapid growth in the number of states and the difficulty in estimating state transition probabilities in practical systems make it very difficult to employ classical methods to find the optimal policy. We present a novel approach that uses a form of discounted reward reinforcement learning known as Q-learning to solve QoS provisioning for wireless adaptive multimedia. Q-learning does not require the explicit state transition model to solve the Markov decision problem, therefore more general and realistic assumptions can be applied to the underlying system model for this approach than in the previous schemes. Moreover, the proposed scheme can efficiently handle the large state space and action set of the wireless adaptive multimedia QoS provisioning problem. Handoff dropping probability and average allocated bandwidth are considered as QoS constraints in our model and can be guaranteed simultaneously. Simulation results demonstrate the effectiveness of the proposed scheme in adaptive multimedia mobile communication networks.


a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2020 The University of British Columbia