Title:
METHOD AND SYSTEM FOR ADAPTIVE CYCLE-LEVEL TRAFFIC SIGNAL CONTROL
Document Type and Number:
WIPO Patent Application WO/2022/057912
Kind Code:
A1
Abstract:
Methods, systems, and processor-readable media for adaptive cycle-level traffic signal control are described. An adaptive cycle-level traffic signal controller and control method that operate within a continuous action space. A reinforcement learning algorithm called Proximal Policy Optimization (PPO), which is a type of actor-critic model for reinforcement learning, may be used to generate signal cycle phase durations selected from a continuous range of values. The controller (220) thus does not treat the action space as discrete, but instead produces continuous values as output. The generated phase durations may define a full traffic signal cycle. The inputs to the controller (220) may indicate current and past states of the traffic environment (200). The average duration of delay of vehicles in the traffic environment may be used to calculate the reward for the reinforcement learning model (240) that drives the behavior of the controller (220).
Inventors:
MOHAMAD ALIZADEH SHABESTARY SOHEIL (CA)
ABDULHAI BAHER (CA)
MA HAO HAI (CA)
HUO YI (CN)
ABDULHAI BAHER (CA)
MA HAO HAI (CA)
HUO YI (CN)
Application Number:
PCT/CN2021/119213
Publication Date:
March 24, 2022
Filing Date:
September 18, 2021
Export Citation:
Assignee:
HUAWEI CLOUD COMPUTING TECH CO LTD (CN)
International Classes:
G08G1/08
Domestic Patent References:
| WO2013086629A1 | 2013-06-20 |
Foreign References:
| CN110428615A | 2019-11-08 | |||
| CN110164150A | 2019-08-23 | |||
| CN111243297A | 2020-06-05 | |||
| KR102155055B1 | 2020-09-11 |
Other References:
SHABESTARY SOHEIL MOHAMAD ALIZADEH; ABDULHAI BAHER: "Deep Learning vs. Discrete Reinforcement Learning for Adaptive Traffic Signal Control", 2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), IEEE, 4 November 2018 (2018-11-04), pages 286 - 293, XP033470173, ISBN: 978-1-7281-0321-1, DOI: 10.1109/ITSC.2018.8569549
ZHANG RUSHENG; LETEURTRE ROMAIN; STRINER BENJAMIN; ALANAZI AMMAR; ALGHAFIS ABDULLAH; TONGUZ OZAN K.: "Partially Detected Intelligent Traffic Signal Control: Environmental Adaptation", 2019 18TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), IEEE, 16 December 2019 (2019-12-16), pages 1956 - 1960, XP033719661, DOI: 10.1109/ICMLA.2019.00314
ZHANG RUSHENG; LETEURTRE ROMAIN; STRINER BENJAMIN; ALANAZI AMMAR; ALGHAFIS ABDULLAH; TONGUZ OZAN K.: "Partially Detected Intelligent Traffic Signal Control: Environmental Adaptation", 2019 18TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), IEEE, 16 December 2019 (2019-12-16), pages 1956 - 1960, XP033719661, DOI: 10.1109/ICMLA.2019.00314
Download PDF:
Previous Patent: BUFFER, MEMORY DEVICE, AND MEMORY BUS SIGNAL PROCESSING METHOD
Next Patent: WATER OUTLET DEVICE HAVING TWO WATER OUTLETS
Next Patent: WATER OUTLET DEVICE HAVING TWO WATER OUTLETS