Research Article
Reconciling Strategic and Tactical Decision Making in Agent-Oriented Simulation of Vehicles in Urban Traffic
@INPROCEEDINGS{10.4108/icst.simutools.2011.245533, author={Maksims Fiosins and Jelena Fiosina and J\o{}rg M\'{y}ller and Jana G\o{}rmer}, title={Reconciling Strategic and Tactical Decision Making in Agent-Oriented Simulation of Vehicles in Urban Traffic}, proceedings={4th International ICST Conference on Simulation Tools and Techniques}, publisher={ICST}, proceedings_a={SIMUTOOLS}, year={2012}, month={4}, keywords={Multi-Agent Systems Decision Making City Traffic Control Stochastic Shortest Path Multi-Agent Reinforcement Learning}, doi={10.4108/icst.simutools.2011.245533} }- Maksims Fiosins
Jelena Fiosina
Jörg Müller
Jana Görmer
Year: 2012
Reconciling Strategic and Tactical Decision Making in Agent-Oriented Simulation of Vehicles in Urban Traffic
SIMUTOOLS
ICST
DOI: 10.4108/icst.simutools.2011.245533
Abstract
We consider an integrated decision making process of autonomous vehicles in agent-oriented simulation of urban traffic systems. In our approach, the planning process for a vehicle agent is separated into two stages: strategic planning and tactical planning. During the strategic planning stage the vehicle agents constructs the optimal route from source to destination; during the tactical planning stage the operative decisions such as speed regulation and lane change are considered. For strategic planning we modify the stochastic shortest path algorithm with imperfect knowledge about network conditions. For tactical planning we apply distributed multiagent reinforcement learning with other vehicles at the same edge. We present planning algorithms for both stages and demonstrate interconnections between them; an example illustrates how the proposed approach may reduce travel time of vehicle agents in urban traffic.