1st International ICST Workshop on Metrology for Grid Networks

Research Article

Long Range Dependent Job Arrival Process and Its Implications in Grid Environments

Download352 downloads
  • @INPROCEEDINGS{10.4108/gridnets.2007.2236,
        author={Hui Li},
        title={Long Range Dependent Job Arrival Process and Its Implications in Grid Environments},
        proceedings={1st International ICST Workshop on Metrology for Grid Networks},
        publisher={ICST},
        proceedings_a={METROGRID},
        year={2007},
        month={10},
        keywords={Point Processes Long Range Dependence Performance Evaluation Computational Grids},
        doi={10.4108/gridnets.2007.2236}
    }
    
  • Hui Li
    Year: 2007
    Long Range Dependent Job Arrival Process and Its Implications in Grid Environments
    METROGRID
    ICST
    DOI: 10.4108/gridnets.2007.2236
Hui Li1,*
  • 1: Leiden Institute of Advanced Computer Science, Leiden University Niels Bohrweg 1, 2333 CA, Leiden, The Netherlands
*Contact email: hui.li@computer.org

Abstract

Job arrivals can be described as point processes and it is shown that correlations and fractal behavior can be reliably revealed using the count/rate representation. Using real workload data from production Grids, we show that the second order properties such as the autocorrelation function (ACF) and the scaling behavior can be well reconstructed by a Multifractal Wavelet Model (MWM). A socalled controlled-variability integrate-and-fire (CV-InF) algorithm is applied to transform rates into interarrivals so that a full description of the arrival process can be obtained. The additive nature of rates makes it possible to model different patterns separately and aggregate them back to form a unified process. We further quantify the performance impacts of autocorrelated job arrivals in Grid scheduling using model-driven simulation. It is shown that autocorrelations in the arrival processes can cause performance degradation both at the local and the Grid level.