Title:
METHOD AND DEVICE FOR SUBMITTING SPARK WORK
Document Type and Number:
WIPO Patent Application WO/2020/248708
Kind Code:
A1
Abstract:
The present invention relates to the field of financial technology. Disclosed are a method and a device for submitting Spark work. The method comprises: receiving a Spark work execution request; obtaining a node blacklist of a Yarn cluster according to the execution request; and creating a Spark engine according to work parameters of a Spark work in the execution request and the node blacklist of the Yarn cluster, and sending the Spark work to the Yarn cluster by means of the Spark engine. The present technical solution prevents submitting the Spark work to failed nodes by obtaining the failed nodes in the Yarn cluster, so as to realize the efficient execution of the Spark work.
Inventors:
LIU YOU (CN)
YIN QIANG (CN)
WANG HEPING (CN)
HUANG SHAN (CN)
YANG ZHIYUE (CN)
DI SHUAI (CN)
LU DAOHE (CN)
YIN QIANG (CN)
WANG HEPING (CN)
HUANG SHAN (CN)
YANG ZHIYUE (CN)
DI SHUAI (CN)
LU DAOHE (CN)
Application Number:
PCT/CN2020/085217
Publication Date:
December 17, 2020
Filing Date:
April 16, 2020
Export Citation:
Assignee:
WEBANK CO LTD (CN)
International Classes:
G06F9/48
Foreign References:
| CN110262881A | 2019-09-20 | |||
| CN105653928A | 2016-06-08 | |||
| CN106980699A | 2017-07-25 | |||
| US20190370146A1 | 2019-12-05 |
Attorney, Agent or Firm:
TDIP & PARTNERS (CN)
Download PDF: