Title:
RMSPROP GRADIENT DESCENT ALGORITHM EXECUTION APPARATUS AND METHOD
Document Type and Number:
WIPO Patent Application WO/2017/185256
Kind Code:
A1
Abstract:
Disclosed in the present invention are an RMSprop gradient descent algorithm execution apparatus and method. The apparatus comprises: a direct memory access unit, an instruction cache unit, a controller unit, a data cache unit, and a data processing module. The method comprises: first reading a gradient vector and a to-be-updated value vector, and initializing a mean square vector; and during each iteration, first updating the mean square vector by using the gradient vector, then calculating, by using the mean square vector, a corresponding gradient descent amount during the update, updating the to-be-updated parameter vector, and repeating the process until the to-be-updated vector converges. In the whole process, the mean square vector is always stored in the data cache unit. By means of the present invention, application of an RMSprop gradient descent algorithm can be implemented, and the efficiency of data processing can be greatly improved.
Inventors:
LIU SHAOLI (CN)
GUO QI (CN)
CHEN TIANSHI (CN)
CHEN YUNJI (CN)
GUO QI (CN)
CHEN TIANSHI (CN)
CHEN YUNJI (CN)
Application Number:
PCT/CN2016/080354
Publication Date:
November 02, 2017
Filing Date:
April 27, 2016
Export Citation:
Assignee:
CAMBRICON TECH CO LTD (CN)
International Classes:
G06F12/00
Domestic Patent References:
| WO2016037351A1 | 2016-03-17 |
Foreign References:
| CN105512723A | 2016-04-20 |
Attorney, Agent or Firm:
CHINA SCIENCE PATENT & TRADEMARK AGENT LTD. (CN)
Download PDF: