ERL: Edge Based Reinforcement Learning for Optimized Urban Traffic Light Control

Pengyuan Zhou, Tristan Braud, Ahmad Alhilal, Pan Hui, Jussi Kangasharju

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu


Traffic congestion is worsening in every major city and brings increasing costs to governments and drivers. Vehicular networks provide the ability to collect more data from vehicles and roadside units, and sense traffic in real time. They represent a promising solution to alleviate traffic jams in urban environments. However, while the collected information is valuable, an efficient solution for better and faster utilization to alleviate congestion has yet to be developed. Current solutions are either based on mathematical models, which do not account for complex traffic scenarios or small-scale machine learning algorithms. In this paper, we propose ERL, a solution based on Edge Computing nodes to collect traffic data. ERL alleviates congestion by providing intelligent optimized traffic light control in real time. Edge servers run fast reinforcement learning algorithms to tune the metrics of the traffic signal control algorithm ran for each intersection. ERL operates within the coverage area of the edge server, and uses aggregated data from neighboring edge servers to provide city-scale congestion control. The evaluation based on real map data shows that our system decreases 48.71 % average waiting time and 32.77% trip duration in normally congested areas, with very fast training in ordinary servers.

Otsikko2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)
JulkaisupaikkaNew York
ISBN (elektroninen)978-1-5386-9151-9
DOI - pysyväislinkit
TilaJulkaistu - 2019
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational Workshop on Smart Edge Computing and Networking - Kyoto, Japani
Kesto: 15 maalisk. 201915 maalisk. 2019
Konferenssinumero: 3


NimiInternational Conference on Pervasive Computing and Communications
ISSN (painettu)2474-2503


  • 113 Tietojenkäsittely- ja informaatiotieteet

Siteeraa tätä