Autonomic Computing and Communications Systems. Third International ICST Conference, Autonomics 2009, Limassol, Cyprus, September 9-11, 2009, Revised Selected Papers

Research Article

Experiences in Benchmarking of Autonomic Systems

Download357 downloads
  • @INPROCEEDINGS{10.1007/978-3-642-11482-3_4,
        author={Xavier Etchevers and Thierry Coupaye and Guy Vachet},
        title={Experiences in Benchmarking of Autonomic Systems},
        proceedings={Autonomic Computing and Communications Systems. Third International ICST Conference, Autonomics 2009, Limassol, Cyprus, September 9-11, 2009, Revised Selected Papers},
        proceedings_a={AUTONOMICS},
        year={2012},
        month={4},
        keywords={Autonomic computing benchmark metrics criteria evaluation comparison return on investment ROI},
        doi={10.1007/978-3-642-11482-3_4}
    }
    
  • Xavier Etchevers
    Thierry Coupaye
    Guy Vachet
    Year: 2012
    Experiences in Benchmarking of Autonomic Systems
    AUTONOMICS
    Springer
    DOI: 10.1007/978-3-642-11482-3_4
Xavier Etchevers1,*, Thierry Coupaye1,*, Guy Vachet1,*
  • 1: Orange Labs
*Contact email: xavier.etchevers@orange-ftgroup.com, thierry.coupaye@orange-ftgroup.com, guy.vachet@orange-ftgroup.com

Abstract

Autonomic computing promises improvements of systems quality of service in terms of availability, reliability, performance, security, etc. However, little research and experimental results have so far demonstrated this assertion, nor provided proof of the return on investment stemming from the efforts that introducing autonomic features requires. Existing works in the area of benchmarking of autonomic systems can be characterized by their qualitative and fragmented approaches. Still a crucial need is to provide generic (i.e. independent from business, technology, architecture and implementation choices) autonomic computing benchmarking tools for evaluating and/or comparing autonomic systems from a technical and, ultimately, an economical point of view. This article introduces a methodology and a process for defining and evaluating factors, criteria and metrics in order to qualitatively and quantitatively assess autonomic features in computing systems. It also discusses associated experimental results on three different autonomic systems.