Publication

A Uniformization Approach for the Dynamic Control of Queueing Systems with Abandonments

queueing systems
Markov chains
dynamic programming
uniformization
scheduling
optimization
Markov decision process
Cox distribution
general abandonments
2018
O. Jouini ,
G. Koole

2018, Operations Research, 66(1), pp.200-209

Résumé

We consider queueing systems with general abandonment. Abandonment times are approximated by a particular Cox distribution with all phase exponential rates being the same. We prove that this distribution arbitrarily closely approximates any nonnegative distribution. By explicitly modeling the waiting time of the first customer in line, we obtain a natural bounded jump Markov process allowing for uniformization. This approach is useful to solve, via dynamic programming, various optimization problems where the objectives and/or constraints involve the distributions of the performance measures, not only their expected values. It is also useful for the performance analysis of queueing systems with general abandonment times.