DEVICE AND METHOD FOR REALIZING DATA SYNCHRONIZATION IN NEURAL NETWORK INFERENCE

Title:

DEVICE AND METHOD FOR REALIZING DATA SYNCHRONIZATION IN NEURAL NETWORK INFERENCE

Document Type and Number:

WIPO Patent Application WO/2021/134519

Kind Code:

A1

Abstract:

Provided are a device and method for realizing data synchronization in neural network inference. The present application relates to the field of artificial intelligence (AI), and in particular to a neural network inference technology. The device comprises: a memory for storing a first feature map, and a neural network processing unit (NPU), the neural network processing unit being used for: acquiring the first feature map from the memory, wherein the first feature map includes M blocks, and M is a positive integer; in an asynchronous manner, respectively executing inference calculation of at least two layers in a neural network model on the M blocks to obtain M inference results, wherein the asynchronous manner refers to not performing data synchronization on an intermediate result obtained by executing inference calculation of one layer in the neural network model on each block but continuing to execute inference calculation of the next layer on the intermediate result; and performing data synchronization on the M inference results to obtain synchronized data. Due to the fact that the NPU only performs data synchronization after executing the inference calculation of at least two layers in the neural network model, the number of instances of data synchronization in the process of neural network inference is small, and therefore, fewer data migration overheads are incurred.

More Like This:

JP2023092985	LEARNING MODEL CREATION DEVICE, PLAN CREATION DEVICE, LEARNING MODEL CREATION METHOD, PLAN CREATION METHOD, AND PROGRAM
WO/2004/114145	NEURAL NETWORKS WITH LEARNING AND EXPRESSION CAPABILITY
WO/2022/259055	SENSOR PERFORMANCE VALIDATION IN ADVANCED DRIVER-ASSISTANCE SYSTEM VERIFICATION

Inventors:

WANG YANYAN (CN)
FENG YUAN (CN)
WU ZUGUANG (CN)
ZHOU PENG (CN)

Application Number:

PCT/CN2019/130638

Publication Date:

July 08, 2021

Filing Date:

December 31, 2019

Export Citation:

Click for automatic bibliography generation Help

Assignee:

HUAWEI TECH CO LTD (CN)

International Classes:

G06N3/08

Foreign References:

CN107704924A	2018-02-16
CN109543754A	2019-03-29
CN106875012A	2017-06-20
US20190012559A1	2019-01-10

Other References: