Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
METHODS AND SYSTEMS FOR BOOSTING DEEP NEURAL NETWORKS FOR DEEP LEARNING
Document Type and Number:
WIPO Patent Application WO/2018/184224
Kind Code:
A1
Abstract:
Methods and systems are disclosed for boosting deep neural networks for deep learning. In one example, in a deep neural network including a first shallow network and a second shallow network, a first training sample is processed by the first shallow network using equal weights. A loss for the first shallow network is determined based on the processed training sample using equal weights. Weights for the second shallow network are adjusted based on the determined loss for the first shallow network. A second training sample is processed by the second shallow network using the adjusted weights. In another example, in a deep neural network including a first weak network and a second weak network, a first subset of training samples is processed by the first weak network using initialized weights. A classification error for the first weak network on the first subset of training samples is determined. The second weak network is boosted using the determined classification error of the first weak network with adjusted weights. A second subset of training samples is processed by the second weak network using the adjusted weights.

Inventors:
WANG, Libin (9F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
GUO, Yiwen (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
YAO, Anbang (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
CAI, Dongqi (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
XU, Lin (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
HU, Ping (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
WANG, Shandong (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
CHENG, Wenhua (8F Raycom Infotech Park A, No. 2 KeXueYuan South RoadZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
CHEN, Yurong (Room 503, Unit 1 Building 4,,QingFengHuaJingYuan, HaiDian Distric, Beijing 5, 100085, CN)
Application Number:
CN2017/079774
Publication Date:
October 11, 2018
Filing Date:
April 07, 2017
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
INTEL CORPORATION (2200 Mission College Blvd, Santa Clara, California, 95054, US)
WANG, Libin (9F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
GUO, Yiwen (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
YAO, Anbang (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
CAI, Dongqi (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
XU, Lin (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
HU, Ping (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
WANG, Shandong (8F Raycom Infotech Park A, No.2 KeXueYuan South Road, ZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
CHENG, Wenhua (8F Raycom Infotech Park A, No. 2 KeXueYuan South RoadZhongGuanCun, HaiDian Distric, Beijing 0, 100190, CN)
CHEN, Yurong (Room 503, Unit 1 Building 4,,QingFengHuaJingYuan, HaiDian Distric, Beijing 5, 100085, CN)
International Classes:
G06F9/30
Attorney, Agent or Firm:
NTD PATENT AND TRADEMARK AGENCY LIMITED (10th Floor, Block A Investment Plaza,27 Jinrongdajie, Xicheng District, Beijing 3, 100033, CN)
Download PDF: