About | Contact Us | Register | Login
ProceedingsSeriesJournalsSearchEAI
9th EAI International Conference on Performance Evaluation Methodologies and Tools

Research Article

Dynamic State Space Partitioning for Adaptive Simulation Algorithms

Cite
BibTeX Plain Text
  • @INPROCEEDINGS{10.4108/eai.14-12-2015.2262710,
        author={Tobias Helms and Steffen Mentel and Adelinde Uhrmacher},
        title={Dynamic State Space Partitioning for Adaptive Simulation Algorithms},
        proceedings={9th EAI International Conference on Performance Evaluation Methodologies and Tools},
        publisher={ACM},
        proceedings_a={VALUETOOLS},
        year={2016},
        month={1},
        keywords={adaptive algorithms reinforcement learning component-based simulation software dynamic state space representations},
        doi={10.4108/eai.14-12-2015.2262710}
    }
    
  • Tobias Helms
    Steffen Mentel
    Adelinde Uhrmacher
    Year: 2016
    Dynamic State Space Partitioning for Adaptive Simulation Algorithms
    VALUETOOLS
    ICST
    DOI: 10.4108/eai.14-12-2015.2262710
Tobias Helms1,*, Steffen Mentel1, Adelinde Uhrmacher1
  • 1: University of Rostock
*Contact email: tobias.helms@uni-rostock.de

Abstract

Adaptive simulation algorithms can automatically change their configuration during runtime to adapt to changing computational demands of a simulation, e.g., triggered by a changing number of model entities or the execution of a rare event. These algorithms can improve the performance of simulations. They can also reduce the configuration effort of the user. By using such algorithms with machine learning techniques, the advantages come with a cost, i.e., the algorithm needs time to learn good adaptation policies and it must be equipped with the ability to observe its environment. An important challenge is to partition the observations to suitable macro states to improve the effectiveness and efficiency of the learning algorithm. Typically, aggregation algorithms, e.g., the adaptive vector quantization algorithm (AVQ), that dynamically partition the state space during runtime are preferred here. In this paper, we integrate the AVQ into an adaptive simulation algorithm.

Keywords
adaptive algorithms reinforcement learning component-based simulation software dynamic state space representations
Published
2016-01-04
Publisher
ACM
http://dx.doi.org/10.4108/eai.14-12-2015.2262710
Copyright © 2015–2025 ICST
EBSCOProQuestDBLPDOAJPortico
EAI Logo

About EAI

  • Who We Are
  • Leadership
  • Research Areas
  • Partners
  • Media Center

Community

  • Membership
  • Conference
  • Recognition
  • Sponsor Us

Publish with EAI

  • Publishing
  • Journals
  • Proceedings
  • Books
  • EUDL