DATA PROCESSING METHOD AND APPARATUS, AND DEVICE AND SYSTEM

WIPO Patent Application WO/2023/237115

A1

Disclosed are a data processing method and apparatus, and a device and a system, which relate to the field of data processing. The method comprises: a scheduler acquiring a job to be processed; controlling at least one super node according to the resource demand of the job to be processed; and on the basis of a global memory pool of the super nodes, processing the job to be processed, wherein the job to be processed is a processing request related to a distributed application. In this way, since a global memory pool is a resource, same is formed by means of unified addressing of storage media of nodes in super nodes and is shared by the nodes in the super nodes. The nodes, which are connected by means of high-speed interconnection technology, in the super nodes share and access the global memory pool, so as to process a job to be processed, such that the nodes in the super nodes are prevented from communicating with each other on the basis of an MPI, thereby simplifying a programming model of an application that is run by the nodes, effectively reducing I/O communication between the nodes, and giving full play to the performance of the super nodes. Therefore, a data processing duration is effectively shortened, and the system energy consumption is reduced, thereby improving the system performance.

SUN HONGWEI (CN)
LI GUANGCHENG (CN)
LI XIUQIAO (CN)
GAO GUIJIN (CN)
LE YONGNIAN (CN)
DING ZHAOHUI (CN)
LIU HUAWEI (CN)

PCT/CN2023/099530

December 14, 2023

June 09, 2023

Click for automatic bibliography generation  

HUAWEI TECH CO LTD (CN)

G06F9/48

CN109951558A	2019-06-28
CN106201720A	2016-12-07
CN114090234A	2022-02-25
US20180357107A1	2018-12-13

View/Download PDF      PDF Help

Previous Patent: MICROSCOPIC IMAGING-BASED ENVIRONMENTAL PRECIPITATION WIND TUNNEL AND APPLICATION THEREOF IN HEALTH ...

Next Patent: PROTEIN DEGRADERS AND USES THEREOF