Urban route planning is a critical challenge for Autonomous Vehicles (AVs) due to the high variability of traffic conditions and the topological complexity of road networks. Traditional routing systems often rely on static maps or algorithms that do not account for the temporal evolution of traffic, resulting in suboptimal solutions in real-world scenarios. This work proposes a Deep Reinforcement Learning (DRL) based framework for optimal path generation in realistic urban environments, leveraging historical traffic data provided by TomTom APIs. The road network of the city of Bari is used as a case study, and traffic conditions are modeled across three distinct time slots to capture typical daily traffic fluctuations. The routing problem is formally modeled as a Markov Decision Process, where the agent interacts with a dynamic environment and learns a policy that minimizes travel time and avoids congestion. The agent is trained using the Proximal Policy Optimization algorithm, a state-of-the-art actor-critic method that ensures stable learning in complex environments. The simulation environment is built using Simulation of Urban MObility, with traffic flows generated coherently with the data collected from TomTom. Experimental results show that the agent trained with time-dependent traffic information outperforms static-data-based strategies, demonstrating the effectiveness of the proposed approach for intelligent and adaptive transportation systems.
A Deep Reinforcement Learning Framework for Real-Time Vehicle Routing with Dynamic Traffic Conditions / Salcuni, A., Volpe, G., Mangini, A.M., Fanti, M.P.. - (2025), pp. 1-7. (2025 International Conference on Recent Advances in Systems Science and Engineering, RASSE 2025 National Library Building, 100 Victoria Street, #13-01, sgp 2025) [10.1109/RASSE64831.2025.11315346].
A Deep Reinforcement Learning Framework for Real-Time Vehicle Routing with Dynamic Traffic Conditions
Salcuni A.;Volpe G.;Mangini A. M.;Fanti M. P.
2025
Abstract
Urban route planning is a critical challenge for Autonomous Vehicles (AVs) due to the high variability of traffic conditions and the topological complexity of road networks. Traditional routing systems often rely on static maps or algorithms that do not account for the temporal evolution of traffic, resulting in suboptimal solutions in real-world scenarios. This work proposes a Deep Reinforcement Learning (DRL) based framework for optimal path generation in realistic urban environments, leveraging historical traffic data provided by TomTom APIs. The road network of the city of Bari is used as a case study, and traffic conditions are modeled across three distinct time slots to capture typical daily traffic fluctuations. The routing problem is formally modeled as a Markov Decision Process, where the agent interacts with a dynamic environment and learns a policy that minimizes travel time and avoids congestion. The agent is trained using the Proximal Policy Optimization algorithm, a state-of-the-art actor-critic method that ensures stable learning in complex environments. The simulation environment is built using Simulation of Urban MObility, with traffic flows generated coherently with the data collected from TomTom. Experimental results show that the agent trained with time-dependent traffic information outperforms static-data-based strategies, demonstrating the effectiveness of the proposed approach for intelligent and adaptive transportation systems.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


