Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
DATA PROCESSING SYSTEM AND APPARATUS
Document Type and Number:
WIPO Patent Application WO/2023/237120
Kind Code:
A1
Abstract:
A data processing system and apparatus. The system comprises a coordination node, a plurality of index nodes and a plurality of working nodes. The coordination node generates first query tasks according to a query request, and sends the first query tasks to the index nodes. A first index node in the plurality of index nodes determines, according to the received first query task, a target fragment comprising data queried based on the query request in a first data range managed by the first index node, and sends information of the target fragment to the coordination node. The coordination node receives information of a plurality of target fragments sent by the plurality of index nodes, generates second query tasks for the plurality of target fragments, and schedules the plurality of working nodes to execute the query request for the plurality of target fragments. In the system, the plurality of index nodes execute index filtering operations in parallel, so that the data processing efficiency is improved; moreover, if the coordination node fails, index information is still available.

Inventors:
LIAO DENGHONG (CN)
ZHANG QI (CN)
TU TIANYI (CN)
Application Number:
PCT/CN2023/099566
Publication Date:
December 14, 2023
Filing Date:
June 11, 2023
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06F16/13; G06F16/242; G06F16/22; G06F16/245; G06F16/2453; G06F16/2455
Foreign References:
CN113132267A2021-07-16
CN108664516A2018-10-16
CN111400301A2020-07-10
CN113127475A2021-07-16
CN105512200A2016-04-20
CN114020790A2022-02-08
CN113886434A2022-01-04
US20190018851A12019-01-17
Download PDF: