Title:
DATA DYNAMIC RE-DISTRIBUTION METHOD, DATA NODE, NAME NODE AND SYSTEM
Document Type and Number:
WIPO Patent Application WO/2016/095760
Kind Code:
A1
Abstract:
The present invention belongs to a technical field of Internet big data processing and disclosed are a data dynamic re-distribution method, data node, name node and system, the method comprising: a first data node receives a read command of a data block (S11); accessing a target data block according to the read command of the data block (S12); generating a copy of the data block of a target data block on a first data node (S13); transmitting a first modifying instruction to the name node (S14). The copy of the data block of the target data block is generated on the first data node, so as to increase number of the data node storing the target data block on the HDFS, and when tasks of accessing the target data block are re-distributed, the number of the local task increases, reducing consumption of the HDFS network resource, improving operation speed of the HDFS, as well as sharing operation task load of the data node storing the data block of the target file, realizing balance of the load.
More Like This:
| JP2000010843 | FILE RETRIEVAL SYSTEM |
| JPH06332955 | MANAGEMENT METHOD FOR CODE DATA AND IMAGE DATA |
| WO/2005/057359 | TRANSPARENT SEARCH ENGINE |
Inventors:
LI JIA (CN)
LIU JIE (CN)
DANG LIFEI (CN)
LIU JIE (CN)
DANG LIFEI (CN)
Application Number:
PCT/CN2015/097172
Publication Date:
June 23, 2016
Filing Date:
December 11, 2015
Export Citation:
Assignee:
HUAWEI TECH CO LTD (CN)
International Classes:
G06F17/30
Foreign References:
| CN102546782A | 2012-07-04 | |||
| CN101187931A | 2008-05-28 | |||
| CN103207867A | 2013-07-17 | |||
| CN101645920A | 2010-02-10 | |||
| CN101470733A | 2009-07-01 | |||
| CN103631894A | 2014-03-12 | |||
| US20140122429A1 | 2014-05-01 |
Download PDF: