Please wait a minute...
浙江大学学报(工学版)
J4  2010, Vol. 44 Issue (5): 915-922    DOI: 10.3785/j.issn.1008-973X.2010.05.014
自动化技术、计算机技术     
一种基于容器的自组织存储模型
余利华1, 陈刚1, 王伟2, 陈柯1, 董金祥1
1.浙江大学 计算机科学与技术学院,浙江 杭州 310027；
2.浙江医学高等专科学校 计算机研究实验室,浙江 杭州 310053
Containerbased self-organizing storage model
YU Li-hua1, CHEN Gang1, WANG Wei2, CHEN Ke1, DONG Jin-xiang1
1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027,China;
2. Department of Computer Education, Zhejiang Medical College, Hangzhou 310027,China
 全文: PDF  HTML
摘要：

针对互联网Web应用特别是Web2.0应用的特殊存储需求,提出一种基于容器的自组织存储模型(CSSM).CSSM使用容器管理存储空间,聚簇存放用户文件,提高用户数据备份、迁移和恢复效率.一方面模型通过文件唯一标识提供文件的快速访问,另一方面它采用文件集来组织用户文件成树状,提供灵活的文件管理功能.模型使用容器作为数据定位和复制的基本单元,并利用对等覆盖网络技术自组织地维护容器元数据.另外,主从容器复制技术和基于容器状态的容器恢复技术保证了数据的可靠性和一致性.利用CSSM实现了一个存储系统原型,初步的实验结果表明,CSSM提供良好的性能和可扩展性,能够满足互联网WEB应用的存储需求.
Abstract:

A containerbased self-organizing storage model (CSS-M) was presented for web2.0 applications. Based on the concept of container, CSS-M clustered the user file together on disk to explore the file access locality and enable the fast data backup, migration and recovery. CSS-M employed ID based access interface to boost the access efficiency, and provided the flexible file management by using collections to organize files into trees. CSS-M maintained the container metadata as softstate and distributed the metadata across all storage nodes using peer to peer technology. Data reliability and consistency were guaranteed by using the primarycopy replication and the state-based container recovery. Experimental results show that CSSM provides high scalability and throughput in file operation services.
出版日期: 2012-03-19
:  TP 309.2  
基金资助:

国家自然科学基金资助项目（60603044）；浙江省重大软件专项资助项目（2006c11108）；长江学者和创新团队发展计划资助项目（IRT0652）.
通讯作者: 陈刚，男，教授，博导.     E-mail: cg@zju.edu.cn
作者简介: 余利华（1982—），男，浙江温岭人，博士生，从事分布式系统、存储系统研究．E-mail: peterylh@163.com
服务　　
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章　　

引用本文:

余利华, 陈刚, 王伟, 陈柯, 董金祥. 一种基于容器的自组织存储模型[J]. J4, 2010, 44(5): 915-922.

TU Li-Hua, CHEN Gang, WANG Wei, CHEN Ke, DONG Jin-Xiang. Containerbased self-organizing storage model. J4, 2010, 44(5): 915-922.

链接本文:

http://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2010.05.014    或    http://www.zjujournals.com/eng/CN/Y2010/V44/I5/915

［1］ LIAN Q, CHEN W, ZHANG Z. On the impact of replica placement to the reliability of distributed brick storage systems ［C］∥ Proceedings of 25th International Conference on Distributed Computing Systems. Columbus: IEEE, 2005: 187196.
［2］ ROWSTRON A, DRUSCHEL P. Pastry: scalable, decentralized object location, and routing for largescale peertopeer systems ［C］∥ Proceedings of International Conference on Distributed Systems Platforms. Heidelberg: Springer, 2001: 329350.
［3］ DABEK F, ZHAO B Y, DRUSCHEL P, et al. Towards a common API for structured peertopeer overlays ［C］∥ Proceedings of 2nd International Workshop on PeertoPeer Systems. Berkeley: Springer, 2003: 3344.
［4］ GUPTA A, LISKOV B, RODRIGUES R. One hop lookups for peertopeer overlays ［C］∥ Proceedings of 9th Workshop on Hot Topics in Operating Systems. Hawaii: USENIX, 2003: 712.
［5］ XIN Q, MILLER E L, SCHWARZ T J E, et al. Reliability mechanisms for very large storage systems ［C］∥Proceedings of IEEE Symposium on Mass Storage Systems. San Diego: IEEE, 2003: 146156.
［6］ CARNS P H, LIGON Ⅲ W B, ROSS R B, et al. PVFS: A parallel file system for Linux clusters ［C］∥ Proceedings of the 4th Annual Linux Showcase and Conference. Atlanta: Usenix, 2000: 317327.
［7］ 杜聪,徐志伟.COSMOS文件系统的性能分析［J］.计算机学报,2001,24 (7): 702709.
DU Cong, XU Zhiwei. Performance analysis of COSMOS file system ［J］. Chinese Journal of Computers, 2001, 24(7):702709.
［8］ XIONG J, MENG S D, SUN N, et al. Design and performance of the dawning cluster file system ［C］∥Proceedings of 2003 IEEE International Conference on Cluster Computing. Hongkong: IEEE, 2003: 232239.
［9］ KUBIATOWICZ J, BINDEL D, CHEN Y, et al. Oceanstore: an architecture for globalscale persistent storage ［C］∥Proceedings of International Conference on Architectural Support for Programming Languages and Operating Systems. Cambrige: ACM, 2000: 190201.
［10］ 田敬,代亚非.P2P持久存储研究综述［J］.软件学报,2007,18 (6): 13791399.
TIAN Jing, DAI Yafei. A survey of durable peertopeer storage techniques ［J］. Journal of Software, 2007, 18 (6): 13791399.
［11］ 胡进锋,洪春晖,郑纬民.一种面向对象的Internet存储系统Granary［J］.计算机研究和发展, 2007, 44 (6): 10711079
HU Jinfeng, HONG Chunhui, ZHENG Weimin. Granary: an architecture of object oriented Internet storage service ［J］. Journal of Computer Research and Development, 2007, 44(6):10711079.
［12］ ZHOU Feng, JIN Chao, WU Yinghui, et al. TODS: cluster object storage platform designed for scalable services ［J］. Future Generation Computer Systems, 2004, 20(4): 549563.
［13］ Upstore ［EB/OL］. ［20061108］. http:∥upstore.grids.cn.
［14］ 程斌,金海.HANDY集群文件系统［J］.华中科技大学学报：自然科学版, 2005, 33 (增1): 3438.
CHENG Bin, JIN Hai. HANDY: a cluster file system with dynamic scalabil ity and high availability ［J］. Journal of Huazhong University of Science and Technology: Nature Science Edition, 2005, 33(supp.1):3438.
［15］ GHEMAWAT S, GOBIOFF H, LEUNG S T. The Google file system ［C］∥Proceedings of the 19th ACM Symposium on Operating Systems Principles. Bolton Landing: ACM, 2003: 2943.
［16］ WEIL S, BRANDT S A, MILLER E L, et al. Ceph: a scalable, highperformance distributed file system ［C］∥Proceedings of the 7th Conference on Operating Systems Design and Implementation. Seattle: Usenix, 2006: 307320.
［17］ TANG H, GULBEDEN A, ZHOU J Y, et al. A selforganizing storage cluster for parallel dataintensive applications ［C］∥ Proceedings of Conference on High Performance Networking and Computing. Pittsburgh: IEEE, 2004: 5254.
［18］ ZHANG Z, LIAN Q, LIN S D, et al. BitVault: a highly reliable distributed data retention platform ［J］. Operating Systems Review, 2007, 41(1): 2736.
［19］ LIAN Q, CHEN W, ZHANG Z, et al. ZRing: fast prefix routing via a low maintenance membership protocol ［C］∥Proceedings of 13th IEEE International Conference on Network Protocols. Boston: IEEE, 2005: 132146.
[1] 陈珂， 胡天磊， 陈刚. 基于角色的信任证覆盖网络中高效信任链搜索[J]. J4, 2010, 44(12): 2241-2250.
[2] 马晨华, 王进, 裘炅, 陆国栋. 基于情景约束的工作流柔性访问控制模型[J]. J4, 2010, 44(12): 2297-2308.
[3] 江颉, 张杰, 陈德人. 基于推理的上下文感知RBAC模型设计和实现[J]. J4, 2009, 43(09): 1609-1614.
[4] 陈珂, 邵峰, 陈刚, 等. XML结构化匹配中的位图过滤加速法[J]. J4, 2009, 43(09): 1549-1556.