Title:
TASK EVALUATION METHOD AND APPARATUS BASED ON DYNAMIC EXPANSION OF FLINK ENGINE COMPUTING NODE
Document Type and Number:
WIPO Patent Application WO/2023/178766
Kind Code:
A1
Abstract:
Provided is a task evaluation method based on the dynamic expansion of a Flink engine computing node, comprising: receiving a task sent by a client; receiving a node expansion instruction sent by the client when a data hotspot occurs, modifying a topological structure of an execution graph of the task according to the node expansion instruction, notifying an upstream operator task of a target operator task to add a result partition, and changing a virtual hash mapping table and a virtual routing table, wherein the target operator task is an operator task having the data hotspot; starting a newly added computing node by means of a task manager, and initializing an input gateway and a result partition of the newly added computing node; notifying a downstream operator task of the target operator task to add an input channel; and processing user data by means of the task manager according to the modified topological structure of the execution graph of the task to obtain a task evaluation result.
Inventors:
SONG MEINA (CN)
LUO XIANYAN (CN)
E HAIHONG (CN)
ZHANG GUANGWEI (CN)
OU ZHONGHONG (CN)
GUO XIAOXUE (CN)
YU XIE (CN)
DONG YAFEI (CN)
LI GUOYING (CN)
GUO JINGJING (CN)
LUO XIANYAN (CN)
E HAIHONG (CN)
ZHANG GUANGWEI (CN)
OU ZHONGHONG (CN)
GUO XIAOXUE (CN)
YU XIE (CN)
DONG YAFEI (CN)
LI GUOYING (CN)
GUO JINGJING (CN)
Application Number:
PCT/CN2022/087209
Publication Date:
September 28, 2023
Filing Date:
April 15, 2022
Export Citation:
Assignee:
BEIJING UNIV OF POSTS & TELECOMMUNICATIONS (CN)
International Classes:
G06F16/22
Foreign References:
| CN113626192A | 2021-11-09 | |||
| CN113377348A | 2021-09-10 | |||
| CN113391907A | 2021-09-14 | |||
| CN111897634A | 2020-11-06 | |||
| US20170124162A1 | 2017-05-04 |
Attorney, Agent or Firm:
TSINGYIHUA INTELLECTUAL PROPERTY LLC (CN)
Download PDF: