A Constrained MDP-Based Vertical Handoff Decision Algorithm for 4G Wireless Networks

TitleA Constrained MDP-Based Vertical Handoff Decision Algorithm for 4G Wireless Networks
Publication TypeConference Paper
Year of Publication2008
AuthorsSun, C., E. Stevens-Navarro, and V. W. S. Wong
Conference NameCommunications, 2008. ICC '08. IEEE International Conference on
Pagination2169 -2174
Date Publishedmay.
Keywords4G mobile communication, 4G wireless networks, 4th generation wireless communication systems, benefit function, call dropping, constrained Markov decision process, constrained MDP-based vertical handoff decision algorithm, heterogeneous wireless access networks, Markov processes, mobility management, mobility management (mobile radio), penalty function, Q-learning algorithms, radio access networks, total access cost constraint, value iteration algorithms

The 4th generation (4G) wireless communication systems aim to provide users with the convenience of seamless roaming among heterogeneous wireless access networks. To achieve this goal, the support of vertical handoff in mobility management is crucial. This paper focuses on the vertical handoff decision algorithm, which determines under what criteria vertical handoff should be performed. The vertical handoff decision problem is formulated as a constrained Markov decision process (CMDP). The objective is to maximize the expected total reward of a connection subject to the expected total access cost constraint. In our model, a benefit function is used to assess the quality of the connection, and a penalty function is used to model signaling and call dropping. The user's velocity and location information are considered when making the handoff decisions. The value iteration and Q-learning algorithms are used to determine the optimal policy. Numerical results show that our proposed vertical handoff decision algorithm outperforms another scheme which does not consider the user's velocity.


a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2020 The University of British Columbia