Title:
DISTRIBUTED PROCESSING SYSTEM AND DISTRIBUTED PROCESSING METHOD
Document Type and Number:
WIPO Patent Application WO/2020/085059
Kind Code:
A1
Abstract:
According to the present invention, a distributed processing node 1[1] transmits distributed data to a distributed processing node 1[2] as intermediate aggregate data. A distributed processing node 1[k] (k=2, …, N) generates updated intermediate aggregate data from received intermediate aggregate data and distributed data and transmits the updated intermediate aggregate data to a distributed processing node 1[k+] (k+=k+1, provided that k+=1 when k=N). Distributed processing node 1[1] transmits received intermediate aggregate data to distributed processing node 1[N] as aggregate data. Distributed processing node 1[k] transmits received aggregate data to distributed processing node 1[k-1]. Distributed processing node 1[1] issues a warning when the aggregate communication time required for the distributed processing nodes 1 to aggregate distributed data or an aggregate distribution communication time that is the total of the aggregate communication time and the time required for the distributed processing nodes 1 to distribute aggregate data has exceeded a prescribed time. As a result, the present invention can perform effective distributed processing when applied to deep learning.
More Like This:
Inventors:
KAWAI KENJI (JP)
KATO JUNICHI (JP)
NGO HUYCU (JP)
ARIKAWA YUKI (JP)
ITO TSUYOSHI (JP)
SAKAMOTO TAKESHI (JP)
KATO JUNICHI (JP)
NGO HUYCU (JP)
ARIKAWA YUKI (JP)
ITO TSUYOSHI (JP)
SAKAMOTO TAKESHI (JP)
Application Number:
PCT/JP2019/039450
Publication Date:
April 30, 2020
Filing Date:
October 07, 2019
Export Citation:
Assignee:
NIPPON TELEGRAPH & TELEPHONE (JP)
International Classes:
G06F15/173; G06N3/08
Other References:
SERGEEV, ALEXANDER ET AL.: "Horovod: fast and easy distributed deep learning in TensorFlow", ARXIV, 21 February 2018 (2018-02-21), pages 1 - 10, XP081215801, Retrieved from the Internet [retrieved on 20191127]
Attorney, Agent or Firm:
YAMAKAWA, Shigeki et al. (JP)
Download PDF:
Previous Patent: DISTRIBUTED PROCESSING SYSTEM AND DISTRIBUTED PROCESSING METHOD
Next Patent: SOLID-STATE IMAGING DEVICE AND IMAGING DEVICE
Next Patent: SOLID-STATE IMAGING DEVICE AND IMAGING DEVICE