Title:
MULTI-AGENT FEDERATED REINFORCEMENT LEARNING-BASED VEHICLE-ROAD COLLABORATIVE CONTROL SYSTEM AND METHOD UNDER COMPLEX INTERSECTION
Document Type and Number:
WIPO Patent Application WO/2024/016386
Kind Code:
A1
Abstract:
Disclosed in the present invention are a multi-agent federated reinforcement learning-based vehicle-road collaborative control system and method under a complex intersection. A vehicle-road collaborative control framework based on a road-end static processing module and a vehicle-end dynamic processing module is provided, and road historical information is supplemented by utilizing road-end advantages; a federated reinforcement learning algorithm FD3 is provided and used for connecting a reinforcement learning module and a federated learning module; the algorithm only transmits neural network parameters rather than vehicle-end data, and thus privacy is protected. The algorithm only selects some neural networks for aggregation, and thus the communication overheads are reduced; a network having a small Q value is selected for aggregation, and overfitting is thus prevented; deep combination of federated learning and reinforcement learning is achieved: an RSU neural network participates in aggregation but does not participate in training, and instead of experience generated by the vehicle end, only an aggregated shared model is used for updating. The privacy of the vehicle end is protected, and the convergence of neural networks is slowed down; only some neural networks are selected to participate in aggregation, and thus the network aggregation cost is reduced.
Inventors:
CAI YINGFENG (CN)
LU SIKAI (CN)
CHEN LONG (CN)
WANG HAI (CN)
YUAN CHAOCHUN (CN)
LIU QINGCHAO (CN)
LI YICHENG (CN)
LU SIKAI (CN)
CHEN LONG (CN)
WANG HAI (CN)
YUAN CHAOCHUN (CN)
LIU QINGCHAO (CN)
LI YICHENG (CN)
Application Number:
PCT/CN2022/110197
Publication Date:
January 25, 2024
Filing Date:
August 04, 2022
Export Citation:
Assignee:
UNIV JIANGSU (CN)
International Classes:
G05D1/02
Foreign References:
| CN112465151A | 2021-03-09 | |||
| CN114463997A | 2022-05-10 | |||
| US20220196414A1 | 2022-06-23 | |||
| CN113743468A | 2021-12-03 |
Attorney, Agent or Firm:
NANJING DOYES INTELLECTUAL PROPERTY CO., LTD. (CN)
Download PDF:
Previous Patent: FLUSHING SYSTEM OF TOILET, AND TOILET
Next Patent: NET-SHAPED OPTICAL FIBER RIBBON AND MANUFACTURING METHOD THEREFOR
Next Patent: NET-SHAPED OPTICAL FIBER RIBBON AND MANUFACTURING METHOD THEREFOR