Title | Self learning call admission control for multimedia wireless DS-CDMA systems |
Publication Type | Conference Paper |
Year of Publication | 2002 |
Authors | Vazquez-Abad, F. J., and V. Krishnamurthy |
Conference Name | Discrete Event Systems, 2002. Proceedings. 6thInternational Workshop on |
Pagination | 399 - 404 |
Keywords | approximation theory, blocking probabilities, call admission, code division multiple access, multimedia communication, optimisation, probability, radiocommunication, self learning, semi Markov decision process, signal to interference ratio, simulation, stochastic gradient algorithm, telecommunication congestion control, transition probability, unsupervised learning, wireless CDMA systems |
Abstract | The call admission problem for wireless CDMA systems is formulated as a semi-Markov decision process with constraints on the blocking probabilities and SIR (signal to interference ratio). We show that the optimal call admission policy can be computed via a stochastic gradient algorithm. Similar to neuro-dynamic programming algorithms, the algorithms proposed are s simulation based and do not require explicit knowledge of the underlying parameters such as transition probabilities (or equivalently invariant distributions). However, unlike Q-learning or temporal difference methods, the algorithms proposed here can straightforwardly handle constraints. |
URL | http://dx.doi.org/10.1109/WODES.2002.1167717 |
DOI | 10.1109/WODES.2002.1167717 |