Optimal control of admission to a station in a closed two queue system

Taposh  Banerjee; Arzad A.  Kherani

1st International ICST Conference on Performance Evaluation Methodologies and Tools

Research Article

Optimal control of admission to a station in a closed two queue system

Cite: BibTeX Plain Text

@INPROCEEDINGS{10.1145/1190095.1190176,
    author={Taposh  Banerjee and Arzad A.  Kherani},
    title={Optimal control of admission to a station in a closed two queue system},
    proceedings={1st International ICST Conference on Performance Evaluation Methodologies and Tools},
    publisher={ACM},
    proceedings_a={VALUETOOLS},
    year={2012},
    month={4},
    keywords={Markov Decision Processes Sensor Networks Dynamic Node activation Stochastic Control},
    doi={10.1145/1190095.1190176}
}

Taposh Banerjee
Arzad A. Kherani
Year: 2012
Optimal control of admission to a station in a closed two queue system
VALUETOOLS
ACM
DOI: 10.1145/1190095.1190176

Taposh Banerjee¹^,*, Arzad A. Kherani¹^,*

1: Dept. of Computer Science and Engineering, Indian Institute of Technology, Delhi, New Delhi, India.

*Contact email: taposh@cse.iitd.ernet.in, alam@cse.iitd.ernet.in

Abstract

We consider a closed queueing system consisting of two stations in tandem. The controller has to make a decision on the number of customers to be admitted for service at the first station so that a long term utility function is maximized. We study the nature of optimal policy for some classes of utility function and transition probability structures. This model can be used to solve many practical closed queueing system problems, like node activation in a rechargeable sensor network. We show that, depending on the number of servers at the various stations, the optimal policy may or may not be greedy.

Keywords: Markov Decision Processes Sensor Networks Dynamic Node activation Stochastic Control

Published: 2012-04-12
Publisher: ACM

: http://dx.doi.org/10.1145/1190095.1190176