Title:
DATA PROCESSING METHOD AND RELATED DEVICE
Document Type and Number:
WIPO Patent Application WO/2023/143262
Kind Code:
A1
Abstract:
The present application relates to the field of artificial intelligence, and discloses a data processing method. The method comprises: processing target data by means of a target neural network to obtain a data processing result, wherein a target header of the target neural network is used for processing a first vector corresponding to first sub-data by means of a first transformation matrix, and processing a second vector corresponding to the first sub-data by means of a second transformation matrix; the first vector corresponds to the location information of the first sub-data in the target data; and the second vector corresponds to the semantic information of the first sub-data. According to the present application, the matrix size of a transformation matrix corresponding to a location vector is set to be smaller than the size of a matrix corresponding to a semantic vector, that is, the size of the first transformation matrix is smaller than the size of the second transformation matrix. The size of the transformation matrix used when the degree of correlation between the location information is calculated can be reduced, so that the overhead of the calculation resource of a model in the process of reasoning or training is reduced.
Inventors:
ZHOU PINGYI (CN)
REN XIAOZHE (CN)
WANG YASHENG (CN)
HE BIN (CN)
MENG XINFAN (CN)
JIANG XIN (CN)
REN XIAOZHE (CN)
WANG YASHENG (CN)
HE BIN (CN)
MENG XINFAN (CN)
JIANG XIN (CN)
Application Number:
PCT/CN2023/072655
Publication Date:
August 03, 2023
Filing Date:
January 17, 2023
Export Citation:
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06N3/08
Foreign References:
| CN113505193A | 2021-10-15 | |||
| CN112288075A | 2021-01-29 | |||
| CN110263324A | 2019-09-20 | |||
| CN110489567A | 2019-11-22 | |||
| CN111368993A | 2020-07-03 | |||
| CN113822282A | 2021-12-21 | |||
| EP3333751A1 | 2018-06-13 | |||
| US20210132949A1 | 2021-05-06 | |||
| US20210383199A1 | 2021-12-09 |
Attorney, Agent or Firm:
SHENPAT INTELLECTUAL PROPERTY AGENCY (CN)
Download PDF: