Title:
DISTRIBUTED PROCESSING SYSTEM AND METHOD FOR PROCESSING DATA
Document Type and Number:
WIPO Patent Application WO/2024/039098
Kind Code:
A1
Abstract:
A method for distributed processing of data is disclosed. According to various embodiments, a distribution system may: store a vertical data layout of an Nth sequence required for a time join in each of elements of a resilient distributed dataset (RDD); distribute and store the elements in electronic devices of the distribution system; enable transmission and reception of the elements between the electronic devices of the distribution system; perform a join operation on the vertical data layouts of the Nth sequence included in the elements; and generate a vertical data layout of an N+1th sequence.
Inventors:
HAN WOOK SHIN (KR)
PARK YEON SU (KR)
HONG KI JAE (KR)
PARK YEON SU (KR)
HONG KI JAE (KR)
Application Number:
PCT/KR2023/010882
Publication Date:
February 22, 2024
Filing Date:
July 27, 2023
Export Citation:
Assignee:
SAMSUNG ELECTRONICS CO LTD (KR)
POSTECH ACAD IND FOUND (KR)
POSTECH ACAD IND FOUND (KR)
International Classes:
G06F16/27; G06F3/06; G06F16/23; G06F16/2455; G06F16/25
Other References:
XIAO WEN; HU JUAN: "SWEclat: a frequent itemset mining algorithm over streaming data using Spark Streaming", THE JOURNAL OF SUPERCOMPUTING, SPRINGER US, NEW YORK, vol. 76, no. 10, 4 February 2020 (2020-02-04), New York, pages 7619 - 7634, XP037245219, ISSN: 0920-8542, DOI: 10.1007/s11227-020-03190-5
SETHI KRISHAN KUMAR; RAMESH DHARAVATH: "HFIM: a Spark-based hybrid frequent itemset mining algorithm for big data processing", THE JOURNAL OF SUPERCOMPUTING, SPRINGER US, NEW YORK, vol. 73, no. 8, 30 January 2017 (2017-01-30), New York, pages 3652 - 3668, XP036281142, ISSN: 0920-8542, DOI: 10.1007/s11227-017-1963-4
KUMAR SUNIL, MOHBEY KRISHNA KUMAR: "A review on big data based parallel and distributed approaches of pattern mining", KING SAUD UNIVERSITY JOURNAL. COMPUTER AND INFORMATION SCIENCES, GENERAL DIRECTORATE FOR ACADEMIC PUBLISHING AND PRESS, SA, vol. 34, no. 5, 1 May 2022 (2022-05-01), SA , pages 1639 - 1662, XP093140672, ISSN: 1319-1578, DOI: 10.1016/j.jksuci.2019.09.006
ROCHD YASSIR, HAFIDI IMAD: "An Efficient Distributed Frequent Itemset Mining Algorithm Based on Spark for Big Data", INTERNATIONAL JOURNAL OF INTELLIGENT ENGINEERING AND SYSTEMS, vol. 12, no. 4, 31 August 2019 (2019-08-31), pages 367 - 377, XP093140673, ISSN: 2185-3118, DOI: 10.22266/ijies2019.0831.34
SONG HWANJUN SONGHWANJUN@KAIST.AC.KR; LEE JAE-GIL JAEGIL@KAIST.AC.KR; HAN WOOK-SHIN WSHAN@POSTECH.AC.KR: "PAMAE Parallel k-Medoids Clustering with High Accuracy and Efficiency", RESEARCH & DEVELOPMENT IN INFORMATION RETRIEVAL, ACM, 2 PENN PLAZA, SUITE 701NEW YORKNY10121-0701USA, 4 August 2017 (2017-08-04) - 12 July 2018 (2018-07-12), 2 Penn Plaza, Suite 701New YorkNY10121-0701USA , pages 1087 - 1096, XP058633587, ISBN: 978-1-4503-5657-2, DOI: 10.1145/3097983.3098098
SETHI KRISHAN KUMAR; RAMESH DHARAVATH: "HFIM: a Spark-based hybrid frequent itemset mining algorithm for big data processing", THE JOURNAL OF SUPERCOMPUTING, SPRINGER US, NEW YORK, vol. 73, no. 8, 30 January 2017 (2017-01-30), New York, pages 3652 - 3668, XP036281142, ISSN: 0920-8542, DOI: 10.1007/s11227-017-1963-4
KUMAR SUNIL, MOHBEY KRISHNA KUMAR: "A review on big data based parallel and distributed approaches of pattern mining", KING SAUD UNIVERSITY JOURNAL. COMPUTER AND INFORMATION SCIENCES, GENERAL DIRECTORATE FOR ACADEMIC PUBLISHING AND PRESS, SA, vol. 34, no. 5, 1 May 2022 (2022-05-01), SA , pages 1639 - 1662, XP093140672, ISSN: 1319-1578, DOI: 10.1016/j.jksuci.2019.09.006
ROCHD YASSIR, HAFIDI IMAD: "An Efficient Distributed Frequent Itemset Mining Algorithm Based on Spark for Big Data", INTERNATIONAL JOURNAL OF INTELLIGENT ENGINEERING AND SYSTEMS, vol. 12, no. 4, 31 August 2019 (2019-08-31), pages 367 - 377, XP093140673, ISSN: 2185-3118, DOI: 10.22266/ijies2019.0831.34
SONG HWANJUN SONGHWANJUN@KAIST.AC.KR; LEE JAE-GIL JAEGIL@KAIST.AC.KR; HAN WOOK-SHIN WSHAN@POSTECH.AC.KR: "PAMAE Parallel k-Medoids Clustering with High Accuracy and Efficiency", RESEARCH & DEVELOPMENT IN INFORMATION RETRIEVAL, ACM, 2 PENN PLAZA, SUITE 701NEW YORKNY10121-0701USA, 4 August 2017 (2017-08-04) - 12 July 2018 (2018-07-12), 2 Penn Plaza, Suite 701New YorkNY10121-0701USA , pages 1087 - 1096, XP058633587, ISBN: 978-1-4503-5657-2, DOI: 10.1145/3097983.3098098
Attorney, Agent or Firm:
MUHANN PATENT & LAW FIRM (KR)
Download PDF: