Title:
NEURAL PROCESSING UNIT SYNCHRONIZATION SYSTEMS AND METHODS
Document Type and Number:
WIPO Patent Application WO/2022/088171
Kind Code:
A1
Abstract:
Systems and methods for exchanging synchronization information between processing units using a synchronization network are disclosed. The disclosed systems and methods include a device including a host and associated neural processing units. Each of the neural processing units can include a command communication module and a synchronization communication module. The command communication module can include circuitry for communicating with the host device over a host network. The synchronization communication module can include circuitry enabling communication between neural processing units over a synchronization network. The neural processing units can be configured to each obtain a synchronized update for a machine learning model. This synchronized update can be obtained at least in part by exchanging synchronization information using the synchronization network. The neural processing units can each maintain a version of the machine learning model and can synchronize it using the synchronized update.
Inventors:
HAN LIANG (US)
WU ZHENGYUAN (US)
LU YE (CN)
WU ZHENGYUAN (US)
LU YE (CN)
Application Number:
PCT/CN2020/125818
Publication Date:
May 05, 2022
Filing Date:
November 02, 2020
Export Citation:
Assignee:
ALIBABA GROUP HOLDING LTD (CN)
International Classes:
H04Q11/00
Foreign References:
| CN111193971A | 2020-05-22 | |||
| CN111582494A | 2020-08-25 | |||
| CN108446770A | 2018-08-24 | |||
| US20200027033A1 | 2020-01-23 |
Attorney, Agent or Firm:
BEIJING TSINGYUANHUI INTELLECTUAL PROPERTY LAW FIRM (CN)
Download PDF: