Title:
PARALLEL DATA PROCESSING SYSTEM, COMPUTER, AND PARALLEL DATA PROCESSING METHOD
Document Type and Number:
WIPO Patent Application WO/2013/179451
Kind Code:
A1
Abstract:
A parallel data processing system having a parallel data processing execution unit for reading data from a data group, which includes a first data group including a plurality of first data and a second data group including a plurality of second data, and executing a process. The parallel data processing execution unit: (A) reads a first data from the first data group, and acquires a first value from the first data on the basis of first format information acquired from an application; (B) generates, on the basis of first reference information acquired from the application, one or more threads for reading from the second data group each of one or more second data corresponding to the first value; (C) executes (A) and (B) with respect to one or more first data of the first data group; and (D) executes a plurality of threads in parallel.
Inventors:
GODA KAZUO (JP)
YAMADA HIROYUKI (JP)
KITSUREGAWA MASARU (JP)
KAWAMURA NOBUO (JP)
FUJIWARA SHINJI (JP)
MOGI KAZUHIKO (JP)
YAMADA HIROYUKI (JP)
KITSUREGAWA MASARU (JP)
KAWAMURA NOBUO (JP)
FUJIWARA SHINJI (JP)
MOGI KAZUHIKO (JP)
Application Number:
PCT/JP2012/064149
Publication Date:
December 05, 2013
Filing Date:
May 31, 2012
Export Citation:
Assignee:
UNIV TOKYO (JP)
HITACHI LTD (JP)
GODA KAZUO (JP)
YAMADA HIROYUKI (JP)
KITSUREGAWA MASARU (JP)
KAWAMURA NOBUO (JP)
FUJIWARA SHINJI (JP)
MOGI KAZUHIKO (JP)
HITACHI LTD (JP)
GODA KAZUO (JP)
YAMADA HIROYUKI (JP)
KITSUREGAWA MASARU (JP)
KAWAMURA NOBUO (JP)
FUJIWARA SHINJI (JP)
MOGI KAZUHIKO (JP)
International Classes:
G06F12/00
Domestic Patent References:
| WO2012049794A1 | 2012-04-19 |
Foreign References:
| JP2010092222A | 2010-04-22 | |||
| JP2011170774A | 2011-09-01 | |||
| US7756919B1 | 2010-07-13 |
Other References:
TAKANORI UEDA ET AL.: "QueueLinker: A Distributed Framework for Pipelined Applications", DAI 2 KAI FORUM ON DATA ENGINEERING AND INFORMATION MANAGEMENT -DEIM 2010- RONBUNSHU, 25 May 2010 (2010-05-25), XP055179049, Retrieved from the Internet [retrieved on 20120802]
JEFFREY DEAN; SANJAY GHEMAWAT: "MapReduce: Simplified Data Processing on Large Clusters", PROCEEDINGS OF OSDI 2004, 2004, pages 137 - 15
MICHAEL ISARD; MIHAI BUDIU; YUAN YU; ANDREW BIRRELL; DENNIS FETTERLY: "Dryad: distributed data-parallel programs from sequential building blocks", PROCEEDINGS OF EUROSYS, 2007, pages 59 - 72
VINAYAK R. BORKAR; MICHAEL J. CAREY; RAMAN GROVER; NICOLA ONOSE; RARES VERNICA: "Hyracks: A flexible and extensible foundation for data-intensive computing", PROCEEDINGS OF ICDE 2011, 2011, pages 1151 - 1162, XP031868515, DOI: doi:10.1109/ICDE.2011.5767921
See also references of EP 2857975A4
JEFFREY DEAN; SANJAY GHEMAWAT: "MapReduce: Simplified Data Processing on Large Clusters", PROCEEDINGS OF OSDI 2004, 2004, pages 137 - 15
MICHAEL ISARD; MIHAI BUDIU; YUAN YU; ANDREW BIRRELL; DENNIS FETTERLY: "Dryad: distributed data-parallel programs from sequential building blocks", PROCEEDINGS OF EUROSYS, 2007, pages 59 - 72
VINAYAK R. BORKAR; MICHAEL J. CAREY; RAMAN GROVER; NICOLA ONOSE; RARES VERNICA: "Hyracks: A flexible and extensible foundation for data-intensive computing", PROCEEDINGS OF ICDE 2011, 2011, pages 1151 - 1162, XP031868515, DOI: doi:10.1109/ICDE.2011.5767921
See also references of EP 2857975A4
Attorney, Agent or Firm:
WILLFORT INTERNATIONAL (JP)
Patent business corporation Wil photograph international patent firm (JP)
Patent business corporation Wil photograph international patent firm (JP)
Download PDF: