Self learning call admission control for multimedia wireless DS-CDMA systems

TitleSelf learning call admission control for multimedia wireless DS-CDMA systems
Publication TypeConference Paper
Year of Publication2002
AuthorsVazquez-Abad, F. J., and V. Krishnamurthy
Conference NameDiscrete Event Systems, 2002. Proceedings. 6thInternational Workshop on
Pagination399 - 404
Keywordsapproximation theory, blocking probabilities, call admission, code division multiple access, multimedia communication, optimisation, probability, radiocommunication, self learning, semi Markov decision process, signal to interference ratio, simulation, stochastic gradient algorithm, telecommunication congestion control, transition probability, unsupervised learning, wireless CDMA systems

The call admission problem for wireless CDMA systems is formulated as a semi-Markov decision process with constraints on the blocking probabilities and SIR (signal to interference ratio). We show that the optimal call admission policy can be computed via a stochastic gradient algorithm. Similar to neuro-dynamic programming algorithms, the algorithms proposed are s simulation based and do not require explicit knowledge of the underlying parameters such as transition probabilities (or equivalently invariant distributions). However, unlike Q-learning or temporal difference methods, the algorithms proposed here can straightforwardly handle constraints.


a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2020 The University of British Columbia