A RAMCloud Storage System based on HDFS: Architecture, implementation and evaluation

详细信息    查看全文

• 作者：Yifeng Luo^a ; ^{luoyf@fudan.edu.cn}Author Vitae ; Siqiang Luo^a ; ^{sqluo@fudan.edu.cn}Author Vitae ; Jihong Guan^b ; ^{jhguan@tongji.edu.cn}Author Vitae ; Shuigeng Zhou^a ; ^{sgzhou@fudan.edu.cn}Author Vitae
• 关键词：Cloud computing ; RAMCloud ; HDFS ; Cloud Storage
• 刊名：Journal of Systems and Software
• 出版年：2013
• 出版时间：March, 2013
• 年：2013
• 卷：86
• 期：3
• 页码：744-750
• 全文大小：632 K

文摘

Few cloud storage systems can handle random read accesses efficiently. In this paper, we present a RAMCloud Storage System, RCSS, to enable efficient random read accesses in cloud environments. Based on the Hadoop Distributed File System?(HDFS), RCSS integrates the available memory resources in an HDFS cluster to form a cloud storage system, which backs up all data on HDFS-managed disks, and fetches data from disks into memory for handy accesses when files are opened for read or specified by users for memory storage. We extend the storage capacity of RCSS to that of the substrate disk-based HDFS by multiplexing all the available memory resources. Furthermore, RCSS supports MapReduce, which is a popular cloud computing paradigm. By serving data from memory instead of disks, RCSS can yield high random I/O performance with low latency and high throughput, and can achieve good availability and scalability as HDFS.