摘要
理想的存储体系结构应该提供安全性、跨平台数据共享、高性能、以及可扩展性,然而当前广泛使用的三种存储结构(DAS,SAN和NAS)都不能兼顾所有这些需求。因此,工业界和学术界正在努力改变目前的存储技术,使存储设备从非智能的、外部管理发展成为智能的、自管理的设备,并且能够感知设备所服务的应用。基于对象的存储(Object-Based Storage)被认为是该问题的解决之道。
一个存储对象是存储设备上的字节的逻辑集合,可以认为对象是“文件”和“块”这两种技术的融合。一方面,对象提供给用户应用一个类似文件的高层抽象,允许不同的操作系统平台之间安全地共享数据;同时还具有数据块技术的优点,提供快速、可扩展的数据访问途径。基于对象的存储的关键贡献就是提供了直接的、类似文件的存储设备访问。
对象由数据、用户可访问属性和设备管理的元数据组成。存储对象的设备称为“基于对象的存储设备(OSD)”。OSD不仅存储数据,还具有传统文件系统的空间管理功能。属性包含了数据的描述信息,是存储设备“意识到”对象如何被访问的关键所在。因此,与块I/O相比,对象提供了更丰富的、更有表达力的接口。应用可以通过属性控制存储设备有针对性的选择存储策略,从而达到预期的目标。
为了实现属性控制的存储策略,关键需要解决两个问题:第一,属性表达什么信息,怎样影响存储策略?第二,属性怎样从用户应用传递给存储设备?围绕这两个问题,磁盘阵列(RAID)被作为研究对象进行了深入研究。
存储需求在快速增长,高性能磁盘阵列是很多大规模存储应用的关键组成部分。磁盘阵列将数据分条放置到多个磁盘,通过增加数据访问的并行性提高存储系统的性能,同时通过数据冗余提高数据可用性。RAID级别的选择是一个令人困扰的问题,因为没有哪一个级别能够做到对所有的负载都是最优的。RAID配置的自动化将大大有助于降低整个存储系统设计的难度和管理维护成本。因此,从研究磁盘阵列的数据布局和应用负载的特征入手,通过考察两者之间的关系,提出根据负载动态选择RAID级别和分条单元大小的数据放置策略。
应用的特征以属性来表示,必须通过一定途径到达设备才能为设备所用。以SCSI OSD协议为基础,建立属性的两种传递机制。一种是调用专门的应用程序接口直接提供属性信息,存储设备根据属性直接做出存储策略选择。另一种是应用程序提供文件系统层的信息,设备内部根据文件的属性做出相关预测,并用于策略选择。比较而言,前者容易实现,而后者要求新的OSD文件系统,好处是不需要修改应用程序。同时还给出了三个属性页的定义作为OSD标准扩展提议。
最后,设计实现了符合T10 OSD标准协议的原型系统(iSCSI-OSD-RAID)。iSCSI协议一直是IP存储的推动力量,已经发展比较成熟。这里利用iSCSI协议作为OSD命令的传输层,加快了系统的实现过程。同时,以一个正在进行的RAID控制器项目为基础,增加了新的对象存储管理模块,最终实现了OSD接口的磁盘阵列,并验证了属性控制的数据放置策略。
An ideal storage architecture would provide strong security, data sharing across platforms, high performance, and scalability in terms of the number of devices and clients. The three storage architectures in common use today are direct-attached storage (DAS), storage area networks (SANs), and network-attached storage (NAS), they cannot meet all of these requirments. Recent industry and academic research suggests a shift in storage technology, in which devices evolve from relatively unintelligent and externally managed to intelligent, self-managed, and aware of the storage applications they serve. However, creating such an intelligent device requires a more expressive interface. Many in the industry believe that an interface based on storage objects can be the answer.
A storage object is a logical collection of bytes on a storage device, which can be regarded as the convergence of two technologies: files and blocks. Files provide user applications with a higher-level storage abstraction that enables secure data sharing across different operating system platforms; and blocks offer fast, scalable access to shared data. Providing direct, file-like access to storage devices is therefore the key contribution of object-based storage. Objects are composed of data, user-accessible attributes, and device-managed metadata. We refer to a device that stores objects as an object-based storage device (OSD), which offloading of space management from storage applications (i.e., the tranditional block-based file systems). Attributes are set of information describing the data. They are also the key to giving storage devices an awareness of how objects are being accessed. Furthermore, an OSD could allow storage applications to establish sessions with the device to encapsulate application-specific parameters such as QoS or data placement policies.
In order to implenment attributes managed policies in object-based storage systems, we have to resolve two key issues. The first, what informatioin is provided by attributes and what storage policy should be choose? The second, How to transfer attributes from user applications to storage devices? We are trying to answer these two questions by focusing on RAID systems in this dissertation.
Storage demands are growing rapidly and high-performance RAID (Redundant Array of Independent Disks) storage is a critical component for many large-scale data-intensive applications. The parallelism of a RAID’s multiple disks provides high bandwidth, while its parity storage provides fault tolerance. While it’s difficult to select the best RAID level for administrators because of no one level is suitable for all types of application workloads. We have studied data layout of disk array, workload features and their relationships, then designed a new data placement policy of dynamically selecting RAID level and stripe unit size depend on workloads.
Furthermore, we established the mechanism for transferring attributes from application to device beased on T10 SCSI OSD protocal. One approach is provide attributes by calling specific APIs, and the other is provide file system information as“hints”for prediction and further policy choice. We also defined three new attribute pages for OSD standard as extention proposal.
At last, we introduced the design and implementation of a prototype system, iSCSI-OSD-RAID, which is compatible to T10 OSD standard (version 1). It use iSCSI protocal as SCSI command transport layer. We developed a OSD target driver over iSCSI on Linux platform based on our RAID controller project. The evaluation results verified performance and the attributes managed data placement policy.
引文
[1] R. J. T. Morris,B. J. Truskowski. The evolution of storage systems. IBM Systems Journal, 2003, 42(2): 205~217
[2] P. Yianilos and S. Sobti. The evolving field of distributed storage. IEEE Internet Computing, 2001, 5(5): 35~39
[3] J. Gray and P. Shenoy. Rules of thumb in data engineering. In Proceedings of the IEEE International Conference on Data Engineering, San Diego, CA, 2000, 3~12
[4] D. A. Patterson, G. A. Gibson, R. H. Katz. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of the International Conference on Management of Data (SIGMOD), 1988. 109~116
[5] A. Azagury, V. Dreizin, M. Factor, E. Henis, D. Naor, N. Rinetzky, O. Rodeh, J. Satran, A. Tavory, and L. Yerushalmi. Towards an Object Store. In the 20th IEEE Symposium on Mass Storage Systems, 2003. 165~175
[6] G. A. Gibson, D. F. Nagle, K. Amiri, et al. File server scaling with network-attached secure disks. In Proceedings of the 1997 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. New York: ACM Press, 1997. 272~284
[7] Garth A. Gibson, David F. Nagle, et al. A Cost-Effective, High-Bandwidth Storage Architecture. In Proceedings of the 8th Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 1998. 92~103
[8] Garth A. Gibson, Rodney Van Meter. Network attached storage architecture. COMMUNICATIONS OF THE ACM, 2000, 43(11): 37~45
[9] Michael Abd-El-Malek, William V. Courtright II, Chuck Cranor, Gregory R. Ganger, et al. Ursa Minor: Versatile Cluster-based Storage. In Proceedings of the 4thUSENIX Conference on File and Storage Technology (FAST '05). San Francisco, CA. December 13-16, 2005. USENIX Association. 59~72
[10] Z. Dubitzky, I. Gold, E. Henis, J. Satran, and D. Sheinwald. DSF: Data sharing facility. Technical report, IBM Haifa Research Labs, 2002
[11] O. Rodeh and A. Teperman. zfs - a scalable distributed file system using object disks. In IEEE Symposium on Mass Storage Systems, 2003. 207~218
[12] SNIA - Storage Networking Industry Association. OSD: Object Based Storage Devices Technical Work Group. http://www.snia.org/tech activities/workgroups/osd/
[13] R. O. Weber. SCSI Object-Based Storage Device Commands (OSD), Document Number: ANSI/INCITS 400-2004. InterNational Committee for Information Technology Standards (formerly NCITS), December 2004.(OSD 标准草案修订版本 10:http://www.t10.org/ftp/t10/drafts/osd/osd-r10.pdf)
[14] M. Factor, K. Meth, D. Naor, O. Rodeh, and J. Satran. Object Storage: The Future Building Block for Storage Systems. A position paper on Object Storage. In proceedings of the 2nd International IEEE Symposium on Mass Storage Systems and Technologies, Sardinia Italy, June 19-24, 2005. 119~123
[15] P. J. Braam. The Lustre storage architecture. Whitepater, Cluster File Systems, Inc., Aug. 2004. http://www.lustre.org/docs/whitepaper.pdf
[16] P. Schwan. Lustre: Building a file system for 1000-node clusters. In Proceedings of the 2003 Linux Symposium, July 2003. 1~7
[17] Panfs: Object-based architecture. http://www.panasas.com/panfs.html
[18] C. K. Wong. Minimizing Expected Head Movement in One-Dimensional and Two-Dimensional Mass Storage Systems. Computing Surveys, 1980, 12(2): 167~178
[19] Paul Vongsathorn, Scott D. Carson. A System for Adaptive Disk Rearrangement. Software-Practice and Experience, 1990, 20(3): 225~242
[20] C. Ruemmler and J. Wilkes. Disk Shuffling. Technical report HPL-91-156. Hewlett-Packard Company, Palo Alto, CA, October 1991. 1~22
[21] Steven W. Schlosser, Jiri Schindler, Stratos Papadomanolakis, Minglong Shao Anastassia Ailamaki, Christos Faloutsos, Gregory R. Ganger. On Multidimensional Data and Modern Disks. In Proceedings of the 4th USENIX Conference on File and Storage Technology (FAST '05). San Francisco, CA. December 13-16, 2005. 225~238
[22] P. M. Chen, E. K. Lee, G. A. Gibson, et al. RAID: high-performance, reliable secondary storage. ACM Computing Surveys, 1994, 26(2): 145~188
[23] Ann L. Drapeau, Ken W. Shirrif, John H. Hartman, Ethan L. Miller, Srinivasan Seshan, Randy H. Katz, Ken Lutz, David A. Patterson, Edward K. Lee, Peter M. Chen, and Garth A. Gibson. RAID-II: a high-bandwidth network file server. In Proceedings of the 21st Annual International Symposium on Computer Architecture, 1994, 234~244
[24] P. Cao, S. B. Lim, S. Venkataraman, and J. Wilkes. The TickerTAIP Parallel RAID Architecture. ACM Transactions on Computer Systems, 1994, 12(3): 236~269
[25] J. Wilkes, R. Golding, C. Staelin and T. Sullivan. The HP AutoRAID hierarchical storage system. ACM Transactions on Computer Systems, 1996, 14(1): 108~136
[26] L. Cabrera and D. Long. Swift: Using distributed disk striping to provide high I/O data rates. ACM Computing Systems, 1991, 4, 405~436
[27] E. K. Lee and C. A. Thekkath. Petal: Distributed virtual disks. In Proceedings of the Seventh International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Cambridge, MA, 1996, 84~92
[28] K. Hwang, H. Jin, and R. S. Ho. Orthogonal striping and mirroring in distributed RAID for I/O-centric cluster computing. IEEE Transactions on Parallel and Distributed Systems, 2002, 13(1): 26~44
[29] T. E. Anderson, M. D. Dahlin, J. M. Neefe, D. A. Patteson, D. S. Roselli, and R. Y. Wang. Serverless network file systems. In 15th Symposium on Operating Systems Principles, ACM Transactions on Computer Systems, 1995. 109~126
[30] S. Frolund, A. Merchant, et al. FAB: enterprise storage systems on a shoestring. In 8th Workshop on Hot Topics in Operating Systems (HOTOS-VIII), Kauai, HI, USENIX Association, 2003. 169~174
[31] J. J. Wylie, M. W. Bigrigg, J. D. Strunk, G. R. Ganger, et al. Survivable information storage systems. IEEE Computer, 2000, 33(8): 61~68
[32] J. Kubiatowicz, D. Bindel, Y. Chen, et al. OceanStore: An architecture for global-scale persistent storage. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 00), ACM, 2000. 190~201
[33] J. H. Hartman and J. K. Ousterhout. The Zebra striped network file system. ACM Transactions on Computer Systems, 1995, 13(3): 279~310
[34] C. Thekkath, T. Mann, and E. Lee. Frangipani: A Scalable Distributed File System. In 16th ACM Symposium on Operating Systems Principles (SOSP), Saint-Malo, France, 1997. 224~237
[35] S. R. Soltis, T. M. Ruwart, G. M. Erickson, K. W. Preslan, and M. T. O'Keefe. The Global File System. In Proceedings of the Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, College Park, MD. IEEE Computer Society Press, 1996. 319~342
[36] D. Anderson, J. Chase, and A. Vahdat. Interposed request routing for scalable network storage. Transactions on Computer Systems (TOCS), 2002, 20(1): 1~24
[37] Hong Tang, Aziz Gulbeden, Jingyu Zhou, Lingkun Chu, and Tao Yang. Sorrento: A Self-Organizing Storage Cluster for Parallel Data-Intensive Applications. Technical Report 2003-30, UCSB, September 2003. 1~14
[38] H. Tang, and T. Yang. An efficient data location protocol for self-organizing storage clusters. In Proceedings of the 2003 ACM/IEEE conference on Supercomputing. IEEE Computer Society, 2003. pages 53
[39] I. Stoica, R. Morris, D. Karger, F. Kaashoek, and H. Balakrishnan. Chord: A scalablepeer-to-peer lookup service for internet applications. ACM SIGCOMM, San Deigo, CA, 2001. 149~160
[40] Satoshi Asami, Nisha Talagala, David Patterson. Designing a Self Maintaining Storage System. In Proceedings of the 1999 IEEE Symposium on Mass Storage Systems, 1999. 222~233
[41] S. Rhea, C. Wells, P. Eaton, D. Geels, B. Zhao, H. Weatherspoon, and J. Kubiatowicz. Maintenance-free global data storage. IEEE Internet Computing, 2001, 5(5): 40~49
[42] 董晓明,谢长生.基于对象的进化存储系统研究.计算机科学,2005,32(11): 223~226
[43] S. Akyurek and K. Salem. Adaptive block rearrangement. ACM Transactions on Computer Systems, 1995, 13(2): 89~121
[44] Nabil J. Sarhan and Chita R. Das. Adaptive Block Rearrangement Algorithms for Video-On-Demand Servers. In Proceedings of the 2001 International Conference on Parallel Processing (ICPP01). Washington, DC, USA: IEEE Computer Society, 2001. 452~462
[45] Gregory R. Ganger, John D. Strunk, Andrew J. Klosterman. Self-* Storage: Brick-based Storage with Automated Administration. Carnegie Mellon University Technical Report, CMU-CS-03-178, August 2003. 1~11
[46] John D. Strunk, Gregory R. Ganger. A Human Organization Analogy for Self-* Systems. First Workshop on Algorithms and Architectures for Self-Managing Systems. In conjunction with Federated Computing Research Conference (FCRC). San Diego, CA. June 11, 2003. 1~6
[47] J. D. Strunk, G. R. Goodson, M. L. Scheinholtz, C. A. N. Soules, and G. R. Ganger. Self-Securing Storage: Protecting Data in Compromised Systems. In Proceedings of the 4th Symposium on Operating Systems Design and Implementation. USENIX Association, 2000. 165~180
[48] Gregory R. Ganger. Blurring the Line Between Oses and Storage Devices. CMUSCS Technical Report CMU-CS-01-166, December 2001. 1~17
[49] E. Riedel, G. Gibson, and C. Faloutsos. Active Storage for Large-Scale Data Mining and Multimedia Applications. In Proceedings of International Conference on Very Large Databases, New York, NY, Aug. 24-27, 1998. 62~73
[50] Erik Riedel and Garth Gibson. Active disks - remote execution for network-attached storage. TR CMU-CS-97-198. December 1997. 1~13
[51] Anurag Acharya, Mustafa Uysal, and Joel Saltz. Active disks: programming model, algorithms and evaluation. Architectural Support for Programming Languages and Operating Systems (San Jose, California), ACM, 3-7 October 1998. 81~91
[52] Kimberly Keeton, David A. Patterson, and Joseph M. Hellerstein. A case for intelligent disks (IDISKs). SIG-MOD Record, 1998, 27(3): 42~52
[53] Eric Anderson, Mahesh Kallahalla, Susan Spence, Ram Swaminathan, and Qian Wang. Quickly finding near-optimal storage system designs. ACM TOCS, 2005. 1~34
[54] Eric Anderson, Ram Swaminathan, Alistair Veitch, et al. Selecting RAID levels for disk arrays. In Proceedings of the FAST 2002 USENIX Conference on File and Storage Technologies, Monterey, CA, January 2002. 189~201
[55] M. Mesnier, G. R. Ganger, and E. Riedel. Object-based Storage. IEEE Communications Magazine, 2003, 41(8): 84~90
[56] INSIC, Data Storage Devices and Systems (DS2) Roadmap. January 2005, 10~20.
[57] Jiri Schindler, John Linwood Griffin, Christopher R. Lumb, Gregory R. Ganger. Track-aligned Extents: Matching Access Patterns to Disk Drive Characteristics. In Proceedings of the FAST 2002 USENIX Conference on File and Storage Technologies, Monterey, CA, January 2002. 259~274
[58] Michael Mesnier, Eno Thereska, Daniel Ellard, Gregory R. Ganger, Margo Seltzer. File Classification in Self-* Storage Systems. In Proceedings of the First International Conference on Autonomic Computing (ICAC-04). New York, NY. May2004. 44~51
[59] R. Golding, et al. Attribute-managed storage. In Workshop on Modeling and Specification of I/O, San Antonio, TX, Oct 1995. 1~4
[60] E. Borowsky, R. Golding, A. Merchant, L. Schreier, E.Shriver, M.Spasojevic, and J. Wilkes. Using attribute-managed storage to achieve QoS. In 5th International Workshop on Quality of Service, Columbia Univ., New York, June 1997. 21~23
[61] E. Shriver. A formalization of the attribute mapping problem. Technical report HPL-SSP-95-10, HP Labs. July 1996. 1~37
[62] K. Voruganti and P. Sarkar. An Anlysis of Three Gigabit Networking Protocols for Storage Area Networks. In 20th IEEE International Performance, Computing, and Communications Conference, April 2001
[63] J. Satran, et al. iSCSI. IETF Work in Progress (IPS group), http://www.ietf.org/html.charters/ips-charter.html, 2001
[64] K. Z. Meth and J. Satran. Design of the iSCSI protocol. In Proceedings of 20th IEEE/11th NASA Goddard Conference, San Diego, California: IEEE, 2003. 116~122
[65] K. Z. Meth and J. Satran. Features of the iscsi protocol. IEEE Communications Magazine, 2003, 41(8): 232~249
[66] P Sarkar and K Voruganti. IP Storage: The Challenge Ahead. In Proceedings of the 19th IEEE Symposium on Mass Storage Systems, College Park, MD, April 2002. 35~42
[67] B. Salmon, E. Thereska, Craig A.N. Soules, G. R. Ganger. A Two-Tiered Software Architecture for Automated Tuning of Disk Layouts. In the First Workshop on Algorithms and Architectures for Self-Managing Systems. ACM, 2003. 13~18
[68] Peter M. Chen, Edward K. Lee. Striping in a RAID Level 5 Disk Array. In Proceedings of the 1995 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, ACM, May 1995. 136~145
[69] Peter M. Chen, David A. Patterson. Maximizing Performance in a Striped Disk Array.In Proceedings of the 1990 International Symposium on Computer Architecture, ACM, May 1990. 322~331
[70] E. K. Lee and R. H. Katz. An analytic performance model of disk arrays. In Proceedings of ACM Conf. on Measurement and Modeling of Computer Systems (SIGMETRICS), May 1993. 98~109
[71] Elizabeth Varki, Arif Merchant, Xiaozhou Qiu. An Analytical Performance Model of Disk Arrays under Synchronous I/O Workloads. HP Technical report, 2002. 1~20
[72] Mustafa Uysal, Guillermo A. Alvarez, and Arif Merchant. A modular, analytical throughput model for modern disk arrays. In Proceedings of the Ninth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems (MASCOTS-2001), Cincinnati, Ohio. 15-18 August 2001. 183~192
[73] G. R. Ganger and Y. N. Patt. Using system-level models to evaluate I/O subsystem designs. IEEE Transactions on Computers, 1998, 47(6): 667~78
[74] G. Ganger, B. Worthington, and Y. Patt. The DiskSim Simulation Environment Version 3.0 Reference Manual, also published as Carnegie Mellon University Technical Report CMU-CS-03-102, January 2003
[75] J.Wilkes. The Pantheon storage-system simulator. Technical Report HPL-SSP-95-14, HP Laboratories, December 1995
[76] William V. Courtright II. A transactional approach to redundant disk array implementation. PhD thesis, Department Electrical Engineering and Computer Science, Carnegie-Mellon University, May 1997. 1~32
[77] Varki E. Mean value technique for closed fork-join networks. In Proceedings SIGMETRICS, May 1999. 103~112
[78] E. Varki and S. X. Wang. A Performance Model of Disk Array Storage Systems. In Proceedings of the Computer Measurement Group's 2000 International Conference, Orlando, Florida, December 2000. 635~644
[79] Chris Ruemmler and John Wilkes. UNIX disk access patterns. In Proceedings of Winter 1993 USENIX. SanDiego, CA, 25-29 January 1993. 405~20
[80] Kim M Y and Tantawi A N. Asynchronous disk interleaving: approximating access delays. IEEE Transactions on Computers, 1991, 40(7): 801~810
[81] M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout. Measurements of a Distributed File System. In Proceedings of the Thirteenth Symposium on Operating System Princi ples, Pacific Grove CA, October 1991, 198~212
[82] Drew Roselli, Jay Lorch, and Tom Anderson. A Comparison of File System Workloads. In Proceedings of 2000 USENIX Technical Conference, San Diego, June 2000. 41~54
[83] Daniel Ellard, Jonathan Ledlie, Pia Malkani and Margo Seltzer. Passive NFS Tracing of Email and Research Workloads. In Proceedings of the Second USENIX Conference on File and Storage Technologies (FAST'03), San Francisco, California. March 2003. 203~216
[84] J. Ousterhout, H. Da Costa, D. Harrison, J. Kunze, M. Kupfer, and J. Thompson. A Trace-Driven Analysis of the UNIX 4.2 BSD File System. In Proceedings of the Tenth Symposium on Operating Systems Principles, December 1985. 15~24
[85] Feng Wang, Scott A. Brandt, Ethan L. Miller, and Darrell D. E. Long. OBFS: A file system for object-based storage devices. In Proceedings of the 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies, College Park, MD, April 2004. IEEE. 283~300
[86] Qin Xin, Ethan L. Miller, Thomas J.E. Schwarz, Darrell D. E. Long, Scott A. Brandt, and Witold Litwin. Reliability mechanisms for very large storage systems. In Proceedings of the 20th IEEE / 11th NASA Goddard Conference on Mass Storage Systems and Technologies, April 2003. 146~156
[87] Peter Corbett, Bob English, Atul Goel, Tomislav Grcanac, Steven Kleiman, James Leong, and Sunitha Sankar. Row-Diagonal Parity for Double Disk Failure Correction.In Proceedings of the Third USENIX Conference on File and Storage Technologies (FAST '04), March 2004. 1~14
[88] Yingping Lu, David H.C. Du, Thomas Ruwart. QoS Provisioning Framework for OSD-based Storage System. In Proceedings of the 22nd IEEE/13th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2005), Monterey, California, USA. April 11-14, 2005. 1~8
[89] 庞丽萍编.操作系统原理(第二版).武汉:华中理工大学出版社,1994.9.225~270
[90] (美)Nils J. Nilsson 著;郑扣根等译.人工智能(Artificial Intelligence).北京:机械工业出版社,2000.9.177~194
[91] (美)Tom Mitchell 著;曾华军等译.机器学习(Machine Learning).北京:机械工业出版社,2003.1.38~56
[92] Ashish Palekar, Narendran Ganapathy, Anshul Chadda, and Robert D. Russell. Design and implementation of a Linux SCSI target for storage area networks. In Proceedings of the 5th Annual Linux Showcase & Conference, Oakland, California, USA, November 5-10, 2001. 1~8
[93] Alexander Ames, Nikhil Bobb, Scott A. Brandt, et al. Richer File System Metadata Using Links and Attributes. In Proceedings of the 22nd IEEE/13th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2005), Monterey, California, USA. April 11-14, 2005. 49~60
[94] D. K. Gifford, P. Jouvelot, M. A. Sheldon, and J. W. O’Toole Jr. Semantic file systems. ACM Symposium on Operating System Principles. Published as Operating Systems Review, 1991, 25(5): 16~25
[95] Xiao-Ming Dong, Ji-Guang Wan, Rui-Fang Liu, and Zhi-Hu Tan. A RAID Controller: Software, Hardware and Embedded Platform Based on Intel IOP321. Z. Wu et al. (Eds.): ICESS 2004, LNCS Volume 3605, 2005. 110~117
[96] Xiaoming Dong, Changsheng Xie, Ruifang Liu, Jiguang Wan. Design and Performance Evaluation of a Disk Array Controller with Fibre Channel Interface. InProceedings of the 7th International Symposium on Optical Storage (ISOS 2005), Zhanjiang, China, April 02-06, SPIE, 2005. 59662B
[97] 谢长生,董晓明,万继光,谭志虎,刘瑞芳.磁盘阵列控制器的设计与原型实现.小型微型计算机系统,2006, 27(1): 173~176
[98] Jeffrey Katcher. PostMark: a new file system benchmark. TR3022. Network Appliance, October 1997. 1~8
