大容量NAND闪存存储管理研究
|
摘要
数据存储设备是航天器的关键设备之一,为多种空间试验及探测设备的数据采集、存储以及在轨处理提供了重要的支撑平台。随着航天电子技术的发展,以闪存(Flash Memory)为基本存储介质的大容量固态存储器已经成为当前航天器数据存储的主流方案之一,因此建立一个大容量、高效率的闪存存储管理机制尤为重要。然而与此同时,针对闪存设备设计的存储管理机制相对落后,现有FlashMemory存储管理机制大多基于上个世纪九十年代和本世纪初的设计,无法满足NAND Flash存储容量飞速增长的要求。
本文在“航天器嵌入式安全操作系统研究”基础软件研究项目和“921二期VxWorks源代码分析”研究项目的工作基础上,深入探讨了大容量NAND闪存的存储管理机制及其实现。
本文首先分析了NAND闪存的特点和NAND闪存的存储管理现状；再在源代码级别上深入研究了Linux MTD和VxWorks TrueFFS两种存储管理方案的原理及其实现；以此为基础提出了一种新的NAND Flash存储管理方案VNFS。
VNFS基于传统UNIX文件系统思想设计,针对NAND Flash的存储特性进行了改进。一是针对文件系统中访问频繁的文件系统关键数据进行冗余存储,建立了浮动的超级块及根目录；二是使用索引节点文件存储文件的索引节点,在存储介质上建立了动态的索引节点树；三是针对Flash存储介质的写入重定位特性采用了漫游树算法。VNFS大幅度的缩短了文件挂载时间,降低了内存消耗,能够满足大容量NAND Flash的管理需要。
Device for data storage is one of the key equipments in the spacecrafts.It provides an important platform to save data for a lot of kinds of space experiments and detection devices.With the development of the spaceflight technology, the large-capacity solid-state storage system based on flash memeory is needed,and the storage management mechanism supporting large capacity and high efficiency is particularly important. The flash memory capacity is growing rapidly in the last few years,and the applications are more and more multiplex. In the other hand,the current designs of storage management mechanism for flash memory is still lagging behind, they are designed in the nineties of last century and the beginning of this century,and can not meet the rapid increasement of the NAND flash memory.
Based on the work of two projects"secure embedded operating system for spacecraft" and "921 second phase source code analysis of vxWorks",this thesis deeply researched implementation of the management mechanism of large-capacity NAND flash memory.
In this thesis,firstly researched the characteristic and the storage management technology status of NAND flash memory;and then deeply analysed two flash memory storage management architechture Linux MTD and VxWorks TrueFFS on source code level.Based on it,this thesis puts forwards a new NAND flash memory management system VNFS.
VNFS is designed based on traditional UNIX filesystem ideology,and aimed at the storage characteristics of NAND Flash.Firstly,it uses drifting super-block; secondly,it uses dynamic tree of index node; thirdly,for the write out of place specialty of flash memory, it uses wandering tree algorithm.VNFS has shorter file system mounting time and less memory consumption, so it can meet the demand for large-capacity flah memory management needs.
本文在“航天器嵌入式安全操作系统研究”基础软件研究项目和“921二期VxWorks源代码分析”研究项目的工作基础上,深入探讨了大容量NAND闪存的存储管理机制及其实现。
本文首先分析了NAND闪存的特点和NAND闪存的存储管理现状；再在源代码级别上深入研究了Linux MTD和VxWorks TrueFFS两种存储管理方案的原理及其实现；以此为基础提出了一种新的NAND Flash存储管理方案VNFS。
VNFS基于传统UNIX文件系统思想设计,针对NAND Flash的存储特性进行了改进。一是针对文件系统中访问频繁的文件系统关键数据进行冗余存储,建立了浮动的超级块及根目录；二是使用索引节点文件存储文件的索引节点,在存储介质上建立了动态的索引节点树；三是针对Flash存储介质的写入重定位特性采用了漫游树算法。VNFS大幅度的缩短了文件挂载时间,降低了内存消耗,能够满足大容量NAND Flash的管理需要。
Device for data storage is one of the key equipments in the spacecrafts.It provides an important platform to save data for a lot of kinds of space experiments and detection devices.With the development of the spaceflight technology, the large-capacity solid-state storage system based on flash memeory is needed,and the storage management mechanism supporting large capacity and high efficiency is particularly important. The flash memory capacity is growing rapidly in the last few years,and the applications are more and more multiplex. In the other hand,the current designs of storage management mechanism for flash memory is still lagging behind, they are designed in the nineties of last century and the beginning of this century,and can not meet the rapid increasement of the NAND flash memory.
Based on the work of two projects"secure embedded operating system for spacecraft" and "921 second phase source code analysis of vxWorks",this thesis deeply researched implementation of the management mechanism of large-capacity NAND flash memory.
In this thesis,firstly researched the characteristic and the storage management technology status of NAND flash memory;and then deeply analysed two flash memory storage management architechture Linux MTD and VxWorks TrueFFS on source code level.Based on it,this thesis puts forwards a new NAND flash memory management system VNFS.
VNFS is designed based on traditional UNIX filesystem ideology,and aimed at the storage characteristics of NAND Flash.Firstly,it uses drifting super-block; secondly,it uses dynamic tree of index node; thirdly,for the write out of place specialty of flash memory, it uses wandering tree algorithm.VNFS has shorter file system mounting time and less memory consumption, so it can meet the demand for large-capacity flah memory management needs.
引文
[1]Arie Tal. Two Technologies Compared: NOR vs. NAND. White Paper. M-Systems,2003
[2]Eran Gal, Sivan Toledo. Algorithms and Data Structures for Flash Memories. ACM Journal,2005
[3]Flash File Systems Overview. White Paper. Intel Corporation,2006
[4]Jesung Kim,Jong Min Kim,Sam H. Noh,Sang Lyul Min and Yookun Cho. A Space-efficient Flash Translation Layer For Compact Flash System.IEEE Transactions on Consumer Electronics, May.2002
[5]Jeong-Uk Kang,Heeseung Jo Jin-Soo,Kim Joonwon Lee. A Superblock-based Flash Translation Layer for NAND Flash Memory. ACM,2006
[6]Seung-Ho Lim, Kyu-Ho Park. An Efficient NAND Flash File System for Flash Memory Storage. IEEE Transaction On Computers, July.2006
[7]Sunhwa Park,Ji Hyun YU,Seong Yong OHM. Atomic Write FTL for Robust Flash File System.IEEE,2005
[8]Guo Peiyuan, Chen Wenhua, Bao Man, Chen Yan, and He Xiaoyan. Design and Implementation of Flash File System in S3C44B0X Embedded system.IEEE, 2006
[9]Seong-jun Ahn, Jong-Moo Choll, Donghee Lee2,Sam Hnoh,Sang Lyumin,Yookun Cho. Design, Implementation, and Performance Evaluation of Flash Memory-based File System on Chip. Journal Of Information Science and Engineering, July.2006
[10]ChinHsien Wu, TeiWei Kuo, LiPin Chang. Efficient Initialization and Crash Recovery for Logbased File Systems over Flash Memory. ACM,2006
[11]Yuan-Hao Chang, Jen-Wei Hsieh, Tei-Wei Kuo. Endurance Enhancement of Flash-Memory Storage. ACM,2007
[12]C.T. Chen, C.H. Chen and W.T. Huang. Energy-aware Management of NAND type Flash File System, Electronics Letters, July.2006
[13]Siddharth Choudhuri, Tony Givargis. Performance Improvement of Block Based NAND Flash Translation Layer. ACM.2007
[14]Chen Tianzhou, Hu Wei, Wang Xiangsheng. Smart File System:Embedded File System Based on NAND-Flash, July.2006
[15]Mendel Rosenblum and John K. The Design and Implementation of a Log-Structured File System, July.1991
[16]Simon Smiganovski,Gregor Jehle. The Linux MTD System.And Flash File Systems, June.2006
[17]Thomas Gleixner. MTD NAND Driver Programming Interface. www.linux-mtd.infradead.org,2004
[18]AB. Bityutskiy. JFFS3 design issues. www.linux-mtd.infradead.org, Nov.2005
[19]Jorn Engel, Robert Mertens. LogFS-Finally a Scalable Flash File System.www.cs.xu.edu,2007
[20]Jorn Engel. Introduction to LogFS, www.lazybastard.org, Nov.2007
[21]Understanding the Flash Translation Layer (FTL) Specification. Intel Corporation, Dec.1998
[22]A. Ban. "Flash File System". US Patent. NO.5404485, Apr.1995
[23]Song-Hwa Park, Tae-Hoon Lee,and Ki-Dong Chung. Design of a NAND Flash Memory File System to Improve System Boot Time.International Journal of Information Processing Systems, Dec.2006
[24]Eran Gal,Sivan Toledo. A Transactional Flash File System for Microcontrollers. Usenix Annual Technical Conference,2005
[25]Eran Gal, Sivan Toledo. Algorithms and data structures for flash memories. ACM Computing Surveys, June.2005
[26]David Woodhouse. JFFS:The Journaling Flash File System. Technical Paper of RedHat inc., Oct.2001
[27]Alessandro Rubini, Kernel Korner. The "Virtual File System" in Linux. Linux Journal, May.1997
[28]李俊奎,刘森林.深入理解Linux虚拟内存管理.北京航空航天大学出版社,2006.5
[29]毛德操,胡希明.Linux内核源代码情景分析.浙江大学出版社,2001.9
[30]陈莉君.深入分析Linux内核源代码.人民邮电出版社,2002.8
[31]孙辉先.基于闪存的星载高速大容量存储技术的研究.中国科学院博士学位论文,2006
[32]阎航.Flash文件系统研究综述.现代计算机,2006.9(243)：63-67
[33]阎航.FAT文件系统在NAND Flash存储器上的改进设计.单片机与嵌入式系统应用,2006.11(11)：27-29
[34]苏沿凯.Flash存储器文件存储格式的探讨.中国科学院硕士学位论文,1998
[35]张文江.银河麒麟日志文件系统的设计与实现.国防科学技术大学工程硕士学位论文,2005
[36]栾志斌.基于TrueFFS理论的固态硬盘在通信领域的应用.吉林大学硕士学位论文,2003
[37]王祥生.嵌入式Linux下大容量Nand闪存文件系统研究.浙江大学硕士学位论文,2007
[38]吴延军.基于FLASH芯片的加密存储技术研究.暨南大学硕士学位论文,2006
[39]查峰.JFFS2文件系统存储策略的研究与实现.大连理工大学硕士学位论文,2006
[40]吴峰光.Linux内核中的预取算法.中国科学技术大学博士学位论文,2008
[2]Eran Gal, Sivan Toledo. Algorithms and Data Structures for Flash Memories. ACM Journal,2005
[3]Flash File Systems Overview. White Paper. Intel Corporation,2006
[4]Jesung Kim,Jong Min Kim,Sam H. Noh,Sang Lyul Min and Yookun Cho. A Space-efficient Flash Translation Layer For Compact Flash System.IEEE Transactions on Consumer Electronics, May.2002
[5]Jeong-Uk Kang,Heeseung Jo Jin-Soo,Kim Joonwon Lee. A Superblock-based Flash Translation Layer for NAND Flash Memory. ACM,2006
[6]Seung-Ho Lim, Kyu-Ho Park. An Efficient NAND Flash File System for Flash Memory Storage. IEEE Transaction On Computers, July.2006
[7]Sunhwa Park,Ji Hyun YU,Seong Yong OHM. Atomic Write FTL for Robust Flash File System.IEEE,2005
[8]Guo Peiyuan, Chen Wenhua, Bao Man, Chen Yan, and He Xiaoyan. Design and Implementation of Flash File System in S3C44B0X Embedded system.IEEE, 2006
[9]Seong-jun Ahn, Jong-Moo Choll, Donghee Lee2,Sam Hnoh,Sang Lyumin,Yookun Cho. Design, Implementation, and Performance Evaluation of Flash Memory-based File System on Chip. Journal Of Information Science and Engineering, July.2006
[10]ChinHsien Wu, TeiWei Kuo, LiPin Chang. Efficient Initialization and Crash Recovery for Logbased File Systems over Flash Memory. ACM,2006
[11]Yuan-Hao Chang, Jen-Wei Hsieh, Tei-Wei Kuo. Endurance Enhancement of Flash-Memory Storage. ACM,2007
[12]C.T. Chen, C.H. Chen and W.T. Huang. Energy-aware Management of NAND type Flash File System, Electronics Letters, July.2006
[13]Siddharth Choudhuri, Tony Givargis. Performance Improvement of Block Based NAND Flash Translation Layer. ACM.2007
[14]Chen Tianzhou, Hu Wei, Wang Xiangsheng. Smart File System:Embedded File System Based on NAND-Flash, July.2006
[15]Mendel Rosenblum and John K. The Design and Implementation of a Log-Structured File System, July.1991
[16]Simon Smiganovski,Gregor Jehle. The Linux MTD System.And Flash File Systems, June.2006
[17]Thomas Gleixner. MTD NAND Driver Programming Interface. www.linux-mtd.infradead.org,2004
[18]AB. Bityutskiy. JFFS3 design issues. www.linux-mtd.infradead.org, Nov.2005
[19]Jorn Engel, Robert Mertens. LogFS-Finally a Scalable Flash File System.www.cs.xu.edu,2007
[20]Jorn Engel. Introduction to LogFS, www.lazybastard.org, Nov.2007
[21]Understanding the Flash Translation Layer (FTL) Specification. Intel Corporation, Dec.1998
[22]A. Ban. "Flash File System". US Patent. NO.5404485, Apr.1995
[23]Song-Hwa Park, Tae-Hoon Lee,and Ki-Dong Chung. Design of a NAND Flash Memory File System to Improve System Boot Time.International Journal of Information Processing Systems, Dec.2006
[24]Eran Gal,Sivan Toledo. A Transactional Flash File System for Microcontrollers. Usenix Annual Technical Conference,2005
[25]Eran Gal, Sivan Toledo. Algorithms and data structures for flash memories. ACM Computing Surveys, June.2005
[26]David Woodhouse. JFFS:The Journaling Flash File System. Technical Paper of RedHat inc., Oct.2001
[27]Alessandro Rubini, Kernel Korner. The "Virtual File System" in Linux. Linux Journal, May.1997
[28]李俊奎,刘森林.深入理解Linux虚拟内存管理.北京航空航天大学出版社,2006.5
[29]毛德操,胡希明.Linux内核源代码情景分析.浙江大学出版社,2001.9
[30]陈莉君.深入分析Linux内核源代码.人民邮电出版社,2002.8
[31]孙辉先.基于闪存的星载高速大容量存储技术的研究.中国科学院博士学位论文,2006
[32]阎航.Flash文件系统研究综述.现代计算机,2006.9(243)：63-67
[33]阎航.FAT文件系统在NAND Flash存储器上的改进设计.单片机与嵌入式系统应用,2006.11(11)：27-29
[34]苏沿凯.Flash存储器文件存储格式的探讨.中国科学院硕士学位论文,1998
[35]张文江.银河麒麟日志文件系统的设计与实现.国防科学技术大学工程硕士学位论文,2005
[36]栾志斌.基于TrueFFS理论的固态硬盘在通信领域的应用.吉林大学硕士学位论文,2003
[37]王祥生.嵌入式Linux下大容量Nand闪存文件系统研究.浙江大学硕士学位论文,2007
[38]吴延军.基于FLASH芯片的加密存储技术研究.暨南大学硕士学位论文,2006
[39]查峰.JFFS2文件系统存储策略的研究与实现.大连理工大学硕士学位论文,2006
[40]吴峰光.Linux内核中的预取算法.中国科学技术大学博士学位论文,2008