Seventh International Conference on Simulation Tools and Techniques

Research Article

Using AI Planning to Automate the Performance Analysis of Simulators

Download520 downloads
  • @INPROCEEDINGS{10.4108/icst.simutools.2014.254635,
        author={Roland Ewald},
        title={Using AI Planning to Automate the Performance Analysis of Simulators},
        proceedings={Seventh International Conference on Simulation Tools and Techniques},
        publisher={ICST},
        proceedings_a={SIMUTOOLS},
        year={2014},
        month={8},
        keywords={performance analysis experiments planning simulation},
        doi={10.4108/icst.simutools.2014.254635}
    }
    
  • Roland Ewald
    Year: 2014
    Using AI Planning to Automate the Performance Analysis of Simulators
    SIMUTOOLS
    ICST
    DOI: 10.4108/icst.simutools.2014.254635
Roland Ewald1,*
  • 1: University of Rostock
*Contact email: roland.ewald@uni-rostock.de

Abstract

Analyzing simulation algorithm performance is cumbersome: execute some runs, observe a performance metric, and analyze the results. Often, the results motivate follow-up experiments, which in turn may lead to additional experiments, and so on. This time-consuming and error-prone process can be automated with planning approaches from artificial intelligence, making simulator performance analysis more convenient and rigorous. This paper introduces Alesia, a prototypical system for automatic simulator performance analysis. It is independent of any specific simulation system and realizes a hypothesis-driven approach to evaluate performance.