Title:
METHOD EXECUTED BY ACCELERATOR, AND ELECTRONIC DEVICE
Document Type and Number:
WIPO Patent Application WO/2023/173639
Kind Code:
A1
Abstract:
A method executed by an accelerator, and an electronic device. The method comprises: receiving a first tensor multiplication instruction for a first thread of an accelerator (802); a first thread set broadcasting a second factor set in a second tensor to a second thread set on the basis of a logical memory address for the second tensor; and a first thread in the second thread set performing a dot product operation on a first factor set and the second factor set on the basis of a first factor register representation, so as to generate a first dot product set in a first row of a third tensor. A matrix is decomposed and threads are allocated according to rows, such that a plurality of threads can process a plurality of rows of a matrix tensor in parallel, thereby improving the processing efficiency of matrix multiplication. In addition, a programmer knows the row-column structure of a matrix tensor and thread condition in an accelerator during programming, therefore the programmer can flexibly use the threads to process matrix multiplication in parallel, thereby improving the programming flexibility.
More Like This:
Inventors:
YANG JINGWEI (CN)
GE JIANMING (CN)
LI JIA (CN)
SANG YONGQI (CN)
XIE GANGFENG (CN)
YAO FEI (CN)
QIU XIAOGANG (CN)
GE JIANMING (CN)
LI JIA (CN)
SANG YONGQI (CN)
XIE GANGFENG (CN)
YAO FEI (CN)
QIU XIAOGANG (CN)
Application Number:
PCT/CN2022/107061
Publication Date:
September 21, 2023
Filing Date:
July 21, 2022
Export Citation:
Assignee:
HEXAFLAKE NANJING INFORMATION TECH CO LTD (CN)
International Classes:
G06F17/16
Foreign References:
| CN114579929A | 2022-06-03 | |||
| CN111814983A | 2020-10-23 | |||
| CN111353126A | 2020-06-30 | |||
| CN111381939A | 2020-07-07 | |||
| CN113836049A | 2021-12-24 | |||
| US20070271325A1 | 2007-11-22 |
Attorney, Agent or Firm:
KING & WOOD MALLESONS (CN)
Download PDF:
Previous Patent: CYLINDER, COMPRESSOR, AND COOLING/HEATING SYSTEM
Next Patent: CARTRIDGE FOR NUCLEIC ACID EXTRACTION AND QUANTITATIVE LIQUID SEPARATION
Next Patent: CARTRIDGE FOR NUCLEIC ACID EXTRACTION AND QUANTITATIVE LIQUID SEPARATION