Research Article
A Performance Experiment System Supporting Fast Mapping of System Issues
@INPROCEEDINGS{10.4108/ICST.VALUETOOLS2009.7807, author={Martin Mroz and Greg Franks}, title={A Performance Experiment System Supporting Fast Mapping of System Issues}, proceedings={4th International ICST Conference on Performance Evaluation Methodologies and Tools}, publisher={ICST}, proceedings_a={VALUETOOLS}, year={2010}, month={5}, keywords={Performance Analysis modeling languages sensitivity experiment control efficient solution}, doi={10.4108/ICST.VALUETOOLS2009.7807} }- Martin Mroz
Greg Franks
Year: 2010
A Performance Experiment System Supporting Fast Mapping of System Issues
VALUETOOLS
ICST
DOI: 10.4108/ICST.VALUETOOLS2009.7807
Abstract
The most fruitful use of a performance model is to study deep properties of the system, and hypothetical situations that might lead to improved configurations or designs. This requires executing experiments on the model, which evaluate systematic changes. Parameter estimation methods also exploit search in a parameter space to fit a model to performance data. Estimation, sensitivity and optimization experiments can require hundreds of evaluations, and the efficiency of the analytic model solver may become an issue. Analytic models usually provide fast solutions (compared to simulations) but repetitive solutions for near-neighbour models offer opportunities for further reducing the effort. This work describes an experiment driver for a layered queueing solver which provides a factor of two improvement. It also raises the issue of domain-specific languages for model experiments, versus general languages with suitable libraries.