3rd International ICST Conference on Performance Evaluation Methodologies and Tools

Research Article

Admission Control and Routing to Parallel Queues with Delayed Information via Marginal Productivity Indices

Download513 downloads
  • @INPROCEEDINGS{10.4108/ICST.VALUETOOLS2008.4409,
        author={Peter Jacko and Jos\^{e} Ni\`{o}o-Mora},
        title={Admission Control and Routing to Parallel Queues with Delayed Information via Marginal Productivity Indices},
        proceedings={3rd International ICST Conference on Performance Evaluation Methodologies and Tools},
        publisher={ICST},
        proceedings_a={VALUETOOLS},
        year={2010},
        month={5},
        keywords={admission control routing parallel queues delayed information index policies restless bandits marginal productivity index},
        doi={10.4108/ICST.VALUETOOLS2008.4409}
    }
    
  • Peter Jacko
    José Niño-Mora
    Year: 2010
    Admission Control and Routing to Parallel Queues with Delayed Information via Marginal Productivity Indices
    VALUETOOLS
    ICST
    DOI: 10.4108/ICST.VALUETOOLS2008.4409
Peter Jacko1,*, José Niño-Mora1,*
  • 1: Department of Statistics, Universidad Carlos III de Madrid, Avda. Universidad 30, 28911 Leganés (Madrid), Spain
*Contact email: peter.jacko@uc3m.es, jnimora@alum.mit.edu

Abstract

This paper addresses the problem of designing and computing a tractable index policy for dynamic job admission control and/or routing in a discrete time Markovian model of parallel loss queues with one-period delayed state observation, which comes close to optimizing an infinite-horizon discounted or average performance objective involving linear holding costs and rejection costs. Instead of devising some ad hoc indices, we deploy a unifying fundamental design principle for design of priority index policies in dynamic resource allocation problems of multiarmed restless bandit type, based on decoupling the problem into subproblems and defining an appropriate marginal productivity index (MPI) for each subproblem. In the model of concern, such subproblems represent admission control problems to a single queue with one-period feedback delay, for which the structure of optimal policies has been characterized in previous work as being of bi-threshold type, yet without giving an algorithm to compute the optimal thresholds. We deploy in such subproblems theoretical and algorithmic results on restless bandit indexation, which yields a fast algorithm that computes the MPI for a subproblem with a buffer size of n performing only O(n) arithmetic operations. Such MPI values can be used both to immediately obtain the optimal thresholds for the subproblem, and to design an index policy for the admission control and/or routing problem in the multi-queue system. The results readily extend to models with infinite buffer space.