A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS

Bing Li, Ke Xu

2011

Abstract

With the development of Cloud Computing, Hadoop –an Infrastructure as a Service open source project of Apache – has been used more and more widely. As the basis of Hadoop, the Hadoop Distributed File System (HDFS) provides basic function of file storage. HDFS-an open source implementation of Google File System (GFS) –was designed for specific demand. Once the demand was changed, HDFS cannot fit it very well. Especially when the access demand of file is different, there will be hot spots and the existing replica will not be enough. It will lower the efficiency of the whole system. This paper introduced a system-level strategy which could adjust the replica number of specific file dynamically. And the experiment shows that this mechanism can prevent the problem of decline of user experience bring by hot spots and improve the overall efficiency.

Paper Citation

in Harvard Style

Li B. and Xu K. (2011). A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS . In Proceedings of the 13th International Conference on Enterprise Information Systems - Volume 1: SSE, (ICEIS 2011) ISBN 978-989-8425-53-9, pages 529-533. DOI: 10.5220/0003587005290533

in Bibtex Style

@conference{sse11,
author={Bing Li and Ke Xu},
title={A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS},
booktitle={Proceedings of the 13th International Conference on Enterprise Information Systems - Volume 1: SSE, (ICEIS 2011)},
year={2011},
pages={529-533},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003587005290533},
isbn={978-989-8425-53-9},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 13th International Conference on Enterprise Information Systems - Volume 1: SSE, (ICEIS 2011)
TI - A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS
SN - 978-989-8425-53-9
AU - Li B.
AU - Xu K.
PY - 2011
SP - 529
EP - 533
DO - 10.5220/0003587005290533