Title:
PARTIAL ACTIVATION OF MULTIPLE PATHWAYS IN NEURAL NETWORKS
Document Type and Number:
WIPO Patent Application WO/2020/174458
Kind Code:
A3
Abstract:
A device, system, and method for approximating a neural network comprising N synapses or filters. The neural network may be partially-activated by iteratively executing a plurality of M partial pathways of the neural network to generate M partial outputs, wherein the M partial pathways respectively comprise M different continuous sequences of synapses or filters linking an input layer to an output layer. The M partial pathways may cumulatively span only a subset of the N synapses or filters such that a significant number of the remaining the N synapses or filters are not computed. The M partial outputs of the M partial pathways may be aggregated to generate an aggregated output approximating an output generated by fully-activating the neural network by executing a single instance of all N synapses or filters of the neural network. Training or prediction of the neural network may be performed based on the aggregated output.
Inventors:
DAVID ELI (IL)
RUBIN ERI (IL)
RUBIN ERI (IL)
Application Number:
PCT/IL2020/050168
Publication Date:
November 12, 2020
Filing Date:
February 13, 2020
Export Citation:
Assignee:
DEEPCUBE LTD (IL)
International Classes:
G06N3/04; G06K9/66; G06N3/08; G06N20/20
Foreign References:
| US20180322606A1 | 2018-11-08 | |||
| US20170277658A1 | 2017-09-28 | |||
| US20180276035A1 | 2018-09-27 | |||
| US20060184462A1 | 2006-08-17 |
Attorney, Agent or Firm:
BARKAI, Yosi et al. (IL)
Download PDF: