Title:
SYSTEM AND METHOD FOR DATA CACHING IN PROCESSING NODES OF MASSIVELY PARALLEL PROCESSING (MPP) DATABASE SYSTEM
Document Type and Number:
WIPO Patent Application WO/2017/005191
Kind Code:
A1
Abstract:
The present technology relates to managing data caching in processing nodes of a massively parallel processing (MPP) database system. A directory is maintained that includes a list and a storage location of the data pages in the MPP database system. Memory usage is monitored in processing nodes by exchanging memory usage information with each other. Each of the processing nodes manages a list and a corresponding amount of available memory in each of the processing nodes based on the memory usage information. Data pages are read from a memory of the processing nodes in response to receiving a request to fetch the data pages, and a remote memory manager is queried for available memory in each of the processing nodes in response to receiving the request. The data pages are distributed to the memory of the processing nodes having sufficient space available for storage during data processing.
Inventors:
LI HUAIZHI (US)
ZHOU QINGQING (US)
ZHANG GUOGEN (US)
ZHOU QINGQING (US)
ZHANG GUOGEN (US)
Application Number:
PCT/CN2016/088898
Publication Date:
January 12, 2017
Filing Date:
July 06, 2016
Export Citation:
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06F17/30
Foreign References:
| US20140280021A1 | 2014-09-18 | |||
| CN102521297A | 2012-06-27 | |||
| US20140310373A1 | 2014-10-16 | |||
| US20140108633A1 | 2014-04-17 | |||
| US20080120273A1 | 2008-05-22 |
Download PDF: