4th International ICST Conference on Simulation Tools and Techniques

Research Article

Reconciling Strategic and Tactical Decision Making in Agent-Oriented Simulation of Vehicles in Urban Traffic

Download40 downloads
  • @INPROCEEDINGS{10.4108/icst.simutools.2011.245533,
        author={Maksims Fiosins and Jelena Fiosina and J\o{}rg M\'{y}ller and Jana G\o{}rmer},
        title={Reconciling Strategic and Tactical Decision Making in Agent-Oriented Simulation of Vehicles in Urban Traffic},
        proceedings={4th International ICST Conference on Simulation Tools and Techniques},
        publisher={ICST},
        proceedings_a={SIMUTOOLS},
        year={2012},
        month={4},
        keywords={Multi-Agent Systems Decision Making City Traffic Control Stochastic Shortest Path Multi-Agent Reinforcement Learning},
        doi={10.4108/icst.simutools.2011.245533}
    }
    
  • Maksims Fiosins
    Jelena Fiosina
    Jörg Müller
    Jana Görmer
    Year: 2012
    Reconciling Strategic and Tactical Decision Making in Agent-Oriented Simulation of Vehicles in Urban Traffic
    SIMUTOOLS
    ICST
    DOI: 10.4108/icst.simutools.2011.245533
Maksims Fiosins1,*, Jelena Fiosina1, Jörg Müller2, Jana Görmer1
  • 1: researcher
  • 2: professor
*Contact email: maksims.fiosins@tu-clausthal.de

Abstract

We consider an integrated decision making process of autonomous vehicles in agent-oriented simulation of urban traffic systems. In our approach, the planning process for a vehicle agent is separated into two stages: strategic planning and tactical planning. During the strategic planning stage the vehicle agents constructs the optimal route from source to destination; during the tactical planning stage the operative decisions such as speed regulation and lane change are considered. For strategic planning we modify the stochastic shortest path algorithm with imperfect knowledge about network conditions. For tactical planning we apply distributed multiagent reinforcement learning with other vehicles at the same edge. We present planning algorithms for both stages and demonstrate interconnections between them; an example illustrates how the proposed approach may reduce travel time of vehicle agents in urban traffic.