Please wait a minute...
浙江大学学报(工学版)
J4  2010, Vol. 44 Issue (5): 915-922    DOI: 10.3785/j.issn.1008-973X.2010.05.014
    
Containerbased self-organizing storage model
YU Li-hua1, CHEN Gang1, WANG Wei2, CHEN Ke1, DONG Jin-xiang1
1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027,China;
2. Department of Computer Education, Zhejiang Medical College, Hangzhou 310027,China
Download:   PDF(0KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A containerbased self-organizing storage model (CSS-M) was presented for web2.0 applications. Based on the concept of container, CSS-M clustered the user file together on disk to explore the file access locality and enable the fast data backup, migration and recovery. CSS-M employed ID based access interface to boost the access efficiency, and provided the flexible file management by using collections to organize files into trees. CSS-M maintained the container metadata as softstate and distributed the metadata across all storage nodes using peer to peer technology. Data reliability and consistency were guaranteed by using the primarycopy replication and the state-based container recovery. Experimental results show that CSSM provides high scalability and throughput in file operation services.

Published: 19 March 2012
CLC:  TP 309.2  
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
Cite this article:

TU Li-Hua, CHEN Gang, WANG Wei, CHEN Ke, DONG Jin-Xiang. Containerbased self-organizing storage model. J4, 2010, 44(5): 915-922.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2010.05.014     OR     http://www.zjujournals.com/eng/Y2010/V44/I5/915


一种基于容器的自组织存储模型

针对互联网Web应用特别是Web2.0应用的特殊存储需求,提出一种基于容器的自组织存储模型(CSSM).CSSM使用容器管理存储空间,聚簇存放用户文件,提高用户数据备份、迁移和恢复效率.一方面模型通过文件唯一标识提供文件的快速访问,另一方面它采用文件集来组织用户文件成树状,提供灵活的文件管理功能.模型使用容器作为数据定位和复制的基本单元,并利用对等覆盖网络技术自组织地维护容器元数据.另外,主从容器复制技术和基于容器状态的容器恢复技术保证了数据的可靠性和一致性.利用CSSM实现了一个存储系统原型,初步的实验结果表明,CSSM提供良好的性能和可扩展性,能够满足互联网WEB应用的存储需求.

［1］ LIAN Q, CHEN W, ZHANG Z. On the impact of replica placement to the reliability of distributed brick storage systems ［C］∥ Proceedings of 25th International Conference on Distributed Computing Systems. Columbus: IEEE, 2005: 187196.
［2］ ROWSTRON A, DRUSCHEL P. Pastry: scalable, decentralized object location, and routing for largescale peertopeer systems ［C］∥ Proceedings of International Conference on Distributed Systems Platforms. Heidelberg: Springer, 2001: 329350.
［3］ DABEK F, ZHAO B Y, DRUSCHEL P, et al. Towards a common API for structured peertopeer overlays ［C］∥ Proceedings of 2nd International Workshop on PeertoPeer Systems. Berkeley: Springer, 2003: 3344.
［4］ GUPTA A, LISKOV B, RODRIGUES R. One hop lookups for peertopeer overlays ［C］∥ Proceedings of 9th Workshop on Hot Topics in Operating Systems. Hawaii: USENIX, 2003: 712.
［5］ XIN Q, MILLER E L, SCHWARZ T J E, et al. Reliability mechanisms for very large storage systems ［C］∥Proceedings of IEEE Symposium on Mass Storage Systems. San Diego: IEEE, 2003: 146156.
［6］ CARNS P H, LIGON Ⅲ W B, ROSS R B, et al. PVFS: A parallel file system for Linux clusters ［C］∥ Proceedings of the 4th Annual Linux Showcase and Conference. Atlanta: Usenix, 2000: 317327.
［7］ 杜聪,徐志伟.COSMOS文件系统的性能分析［J］.计算机学报,2001,24 (7): 702709.
DU Cong, XU Zhiwei. Performance analysis of COSMOS file system ［J］. Chinese Journal of Computers, 2001, 24(7):702709.
［8］ XIONG J, MENG S D, SUN N, et al. Design and performance of the dawning cluster file system ［C］∥Proceedings of 2003 IEEE International Conference on Cluster Computing. Hongkong: IEEE, 2003: 232239.
［9］ KUBIATOWICZ J, BINDEL D, CHEN Y, et al. Oceanstore: an architecture for globalscale persistent storage ［C］∥Proceedings of International Conference on Architectural Support for Programming Languages and Operating Systems. Cambrige: ACM, 2000: 190201.
［10］ 田敬,代亚非.P2P持久存储研究综述［J］.软件学报,2007,18 (6): 13791399.
TIAN Jing, DAI Yafei. A survey of durable peertopeer storage techniques ［J］. Journal of Software, 2007, 18 (6): 13791399.
［11］ 胡进锋,洪春晖,郑纬民.一种面向对象的Internet存储系统Granary［J］.计算机研究和发展, 2007, 44 (6): 10711079
HU Jinfeng, HONG Chunhui, ZHENG Weimin. Granary: an architecture of object oriented Internet storage service ［J］. Journal of Computer Research and Development, 2007, 44(6):10711079.
［12］ ZHOU Feng, JIN Chao, WU Yinghui, et al. TODS: cluster object storage platform designed for scalable services ［J］. Future Generation Computer Systems, 2004, 20(4): 549563.
［13］ Upstore ［EB/OL］. ［20061108］. http:∥upstore.grids.cn.
［14］ 程斌,金海.HANDY集群文件系统［J］.华中科技大学学报：自然科学版, 2005, 33 (增1): 3438.
CHENG Bin, JIN Hai. HANDY: a cluster file system with dynamic scalabil ity and high availability ［J］. Journal of Huazhong University of Science and Technology: Nature Science Edition, 2005, 33(supp.1):3438.
［15］ GHEMAWAT S, GOBIOFF H, LEUNG S T. The Google file system ［C］∥Proceedings of the 19th ACM Symposium on Operating Systems Principles. Bolton Landing: ACM, 2003: 2943.
［16］ WEIL S, BRANDT S A, MILLER E L, et al. Ceph: a scalable, highperformance distributed file system ［C］∥Proceedings of the 7th Conference on Operating Systems Design and Implementation. Seattle: Usenix, 2006: 307320.
［17］ TANG H, GULBEDEN A, ZHOU J Y, et al. A selforganizing storage cluster for parallel dataintensive applications ［C］∥ Proceedings of Conference on High Performance Networking and Computing. Pittsburgh: IEEE, 2004: 5254.
［18］ ZHANG Z, LIAN Q, LIN S D, et al. BitVault: a highly reliable distributed data retention platform ［J］. Operating Systems Review, 2007, 41(1): 2736.
［19］ LIAN Q, CHEN W, ZHANG Z, et al. ZRing: fast prefix routing via a low maintenance membership protocol ［C］∥Proceedings of 13th IEEE International Conference on Network Protocols. Boston: IEEE, 2005: 132146.
[1] MA Chen-hua, WANG Jing, QIU Jiong, LU Guo-dong. Flexible context-constraint-based access control model
for workflows[J]. J4, 2010, 44(12): 2297-2308.
[2] CHEN Ke, HU Tian-lei, CHEN Gang. Fast trust chain search in role-based credential overlay network[J]. J4, 2010, 44(12): 2241-2250.
[3] JIANG Jia, ZHANG Jie, CHEN De-Ren. Design and implementation of context-aware RBAC model based on reasoning[J]. J4, 2009, 43(09): 1609-1614.
[4] CHEN Ke, SHAO Feng, CHEN Gang, et al. Accelerating XML structural matching using bitmap filtration[J]. J4, 2009, 43(09): 1549-1556.