一种基于捎带回收的瓦记录Raid5写顺序化方法
|
摘要
瓦记录技术(SMR)采用部分叠加相邻磁道的方式增大磁盘碟片的面密度,其磁道相互叠加,使得瓦记录磁盘无法进行原地更新,是因为直接更新某一磁道上的数据可能会覆盖掉相邻磁道上的有效数据,导致瓦记录磁盘的非顺序写需要引入额外的写放大开销。对于由瓦记录磁盘组成的Raid5来说,在非顺序写场景下,最终落盘的IO也是非顺序的,因此单盘性能下降,会极大地影响瓦记录Raid5的非顺序写性能。针对瓦记录Raid5非顺序写性能低的问题,提出了一种基于捎带回收的瓦记录Raid5。该方法改进了传统Raid5的小写过程,在小写读的时候捎带读取附近的可被回收的数据或校验,通过将落盘写IO日志化,实现了落盘写IO的顺序化,避免了瓦记录磁盘的写放大开销。系统维护了地址映射表等元数据,在重构时只需对应用访问过的条带进行读写和计算,这减少了重构时需要读写的数据量。测试显示,在某些非顺序写场景下,写带宽超过了以Bcache作为缓存的MD Raid5。从计算结果看,重构时的读写开销相比普通磁盘组建的MD Raid5也有明显减小。
Shingled magnetic recording(SMR) increases surface density by partly overlapping adjacent tracks,which can't support in-place update,because updating data on one track directly will destroy the data on successive tracks. So it needs to bring in additional overhead to avoid write overlapping. For SWD Raid5,in non-sequential write scene,final IOs sent to disk are also non-sequential,which affects the Raid5 performance greatly. A piggyback garbage collection Raid5(PRaid5) is proposed to improve write performance of SWD Raid5 by modifying Raid5 RMW and write sequentialization. Since address mapping table is recorded,it needs not to read whole disk as recoverying. Test results show that in some non-sequential writing scenarios,PRaid5 has higher performance and lower read/write overhead than Linux MD Raid5.
Shingled magnetic recording(SMR) increases surface density by partly overlapping adjacent tracks,which can't support in-place update,because updating data on one track directly will destroy the data on successive tracks. So it needs to bring in additional overhead to avoid write overlapping. For SWD Raid5,in non-sequential write scene,final IOs sent to disk are also non-sequential,which affects the Raid5 performance greatly. A piggyback garbage collection Raid5(PRaid5) is proposed to improve write performance of SWD Raid5 by modifying Raid5 RMW and write sequentialization. Since address mapping table is recorded,it needs not to read whole disk as recoverying. Test results show that in some non-sequential writing scenarios,PRaid5 has higher performance and lower read/write overhead than Linux MD Raid5.
引文
[1]Wood R,Williams M,Kavcic A,et al.The feasibility of magnetic recording at 10 terabits per square inch on conventional media[J].IEEE Transactions on Magnetics,2009,45:917-923
[2]Richter H,Dobin A,Heinonen O,et al.Recording on bit-patterned media at densities of 1Tb/in 2 and beyound[J].IEEE Transactions on Magnetics,2006,42(10):2255-2260
[3]White R L,New R M H,Pease R F W.Patterned media:A viable route to 50 Gbit/in 2 and Up for magnetic recording?[J].IEEE Transactions on Magnetics,1997,33(1):990-995
[4]Kryder M H,Gage E C,Mc Daniel T W,et al.Heat assisted magnetic recording[J].Proceedings of the IEEE,2008,96(11):1810-1835
[5]Igarashi M,Suzuki Y,Miyamoto H,et al.Effective write field for microwave assisted magnetic recording[J].IEEE Transactions on Magnetics,2010,46(6):2507-2509
[6]Zhu J G,Zhu X C,Tang Y H.Microwave assisted magnetic recording[J].IEEE Transactions on Magnetics,2008,44(1):125-131
[7]Sohn J S,Lee D,Cho E,et al.Fabrication and MFM study of 60 nm track-pitch discrete track media[J].Nanotechnology,2011,22(3):353
[8]Amer A,Holliday J,Long D D E,et al.Data management and layout for shingled magnetic recording[J].IEEE Transactions on Magnetics,2011,47(10):3691-3697
[9]肖文健.Hs-SWD:基于瓦记录磁盘的混合存储系统:[硕士学位论文][D].北京:中国科学院大学,2016
[10]罗旦.瓦记录磁盘系统数据组织关键技术研究:[博士学位论文][D].武汉:华中科技大学计算机学院,2016
[11]Greaves S,Kanai Y,Muraoka H.Shingled Recording for2-3 Tbit/in2[J].IEEE Transactions on Magnetics,2009,45(10):3823-3829
[12]Information technology-Zoned Block Commands(ZBC).Draft Standard T10/BSR INCITS 536[S].American National Standards Institute,Inc.,September 2014.http://www.t10.org/ftp/zbcr01.pdf
[13]Information technology-Zoned Device ATA Command Set(ZAC).Draft Standard T13/BSR INCITS 537[S].American National Standards Institute,Inc.,December2015.http://www.t13.org/Documents/Uploaded Documents/docs2015/di537r05-Zoned_Device_ATA_Command_Set_ZAC.pdf
[14]Amer A,Holliday J A,Long D D E,et al.Data management and layout for shingled magnetic recording[J].IEEE Transactions on Magnetics,2011,47(10):3691-3697
[15]Gibson G,Polte M.Directions for shingled-write and twodimensional magnetic recording system architectures:synergies with solid-state disks,CMU-PDL-09-104[R].Pittsburgh PA:Parallel Data Lab,Carnegie Mellon University,2009
[16]Gibson G,Ganger G.Principles of Operation for Shingled Disk Devices.CMU-PDL-11-107[R].Pittsburgh,PA:Parallel Data Lab,Carnegie Mellon University,2011
[17]Amer A,Long D D E,Miller E L,et al.Design issues for a shingled write disk system[C].In:Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technologies(MSST),Incline Village,USA,2010.1-12
[18]Feldman T,Gibson G.Shingled magnetic recording areal density increase requires new data management[EB/OL].https://www.usenix.org/system/files/login/articles/05_feldman_022-030_final.pdf
[19]Pitchumani R,Hospodor A,Amer A,et al.Emulating a shingled write disk[C].In:Proceedings of IEEE 20th International Symposium on Modeling,Analysis&Simulation of Computer and Telecommunication Systems(MASCOTS),Washington,DC,USA,2012.339-346
[20]Luo D,Wan J G,Zhu Y F,et al.Design and implementation of a hybrid shingled write disk system[J].IEEE Transactions on Parallel and Distributed Systems,2016,27(4):1017-1029
[21]Cassuto Y,M.Sanvido A A,Guyot C,et al.Indirection systems for shingled-recording disk drives[C].In:Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technologies(MSST),Lake Tahoe,USA,2010.1-14
[22]Lin C-I,Park D,He W,et al.H-swd:Incorporating hot data identification into shingled write disks[C].In:Proceedings of IEEE 20th International Symposium on Modeling,Analysis Simulation of Computer and Telecommunication Systems(MASCOTS),Washington,DC,USA,2012.321-330
[23]Liu W,Feng D,Zeng L,et al.Understanding the SWDbased raid system[C].In:Proceedings of International Conference on Cloud Computing and Big Data,Wuhan,China,2014.175-181
[24]Aghayev A,Shafaei M,Desnoyers P.Skylight-a window on shingled disk operation[J].ACM Transactions on Storage,2015,11(4):16
[2]Richter H,Dobin A,Heinonen O,et al.Recording on bit-patterned media at densities of 1Tb/in 2 and beyound[J].IEEE Transactions on Magnetics,2006,42(10):2255-2260
[3]White R L,New R M H,Pease R F W.Patterned media:A viable route to 50 Gbit/in 2 and Up for magnetic recording?[J].IEEE Transactions on Magnetics,1997,33(1):990-995
[4]Kryder M H,Gage E C,Mc Daniel T W,et al.Heat assisted magnetic recording[J].Proceedings of the IEEE,2008,96(11):1810-1835
[5]Igarashi M,Suzuki Y,Miyamoto H,et al.Effective write field for microwave assisted magnetic recording[J].IEEE Transactions on Magnetics,2010,46(6):2507-2509
[6]Zhu J G,Zhu X C,Tang Y H.Microwave assisted magnetic recording[J].IEEE Transactions on Magnetics,2008,44(1):125-131
[7]Sohn J S,Lee D,Cho E,et al.Fabrication and MFM study of 60 nm track-pitch discrete track media[J].Nanotechnology,2011,22(3):353
[8]Amer A,Holliday J,Long D D E,et al.Data management and layout for shingled magnetic recording[J].IEEE Transactions on Magnetics,2011,47(10):3691-3697
[9]肖文健.Hs-SWD:基于瓦记录磁盘的混合存储系统:[硕士学位论文][D].北京:中国科学院大学,2016
[10]罗旦.瓦记录磁盘系统数据组织关键技术研究:[博士学位论文][D].武汉:华中科技大学计算机学院,2016
[11]Greaves S,Kanai Y,Muraoka H.Shingled Recording for2-3 Tbit/in2[J].IEEE Transactions on Magnetics,2009,45(10):3823-3829
[12]Information technology-Zoned Block Commands(ZBC).Draft Standard T10/BSR INCITS 536[S].American National Standards Institute,Inc.,September 2014.http://www.t10.org/ftp/zbcr01.pdf
[13]Information technology-Zoned Device ATA Command Set(ZAC).Draft Standard T13/BSR INCITS 537[S].American National Standards Institute,Inc.,December2015.http://www.t13.org/Documents/Uploaded Documents/docs2015/di537r05-Zoned_Device_ATA_Command_Set_ZAC.pdf
[14]Amer A,Holliday J A,Long D D E,et al.Data management and layout for shingled magnetic recording[J].IEEE Transactions on Magnetics,2011,47(10):3691-3697
[15]Gibson G,Polte M.Directions for shingled-write and twodimensional magnetic recording system architectures:synergies with solid-state disks,CMU-PDL-09-104[R].Pittsburgh PA:Parallel Data Lab,Carnegie Mellon University,2009
[16]Gibson G,Ganger G.Principles of Operation for Shingled Disk Devices.CMU-PDL-11-107[R].Pittsburgh,PA:Parallel Data Lab,Carnegie Mellon University,2011
[17]Amer A,Long D D E,Miller E L,et al.Design issues for a shingled write disk system[C].In:Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technologies(MSST),Incline Village,USA,2010.1-12
[18]Feldman T,Gibson G.Shingled magnetic recording areal density increase requires new data management[EB/OL].https://www.usenix.org/system/files/login/articles/05_feldman_022-030_final.pdf
[19]Pitchumani R,Hospodor A,Amer A,et al.Emulating a shingled write disk[C].In:Proceedings of IEEE 20th International Symposium on Modeling,Analysis&Simulation of Computer and Telecommunication Systems(MASCOTS),Washington,DC,USA,2012.339-346
[20]Luo D,Wan J G,Zhu Y F,et al.Design and implementation of a hybrid shingled write disk system[J].IEEE Transactions on Parallel and Distributed Systems,2016,27(4):1017-1029
[21]Cassuto Y,M.Sanvido A A,Guyot C,et al.Indirection systems for shingled-recording disk drives[C].In:Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technologies(MSST),Lake Tahoe,USA,2010.1-14
[22]Lin C-I,Park D,He W,et al.H-swd:Incorporating hot data identification into shingled write disks[C].In:Proceedings of IEEE 20th International Symposium on Modeling,Analysis Simulation of Computer and Telecommunication Systems(MASCOTS),Washington,DC,USA,2012.321-330
[23]Liu W,Feng D,Zeng L,et al.Understanding the SWDbased raid system[C].In:Proceedings of International Conference on Cloud Computing and Big Data,Wuhan,China,2014.175-181
[24]Aghayev A,Shafaei M,Desnoyers P.Skylight-a window on shingled disk operation[J].ACM Transactions on Storage,2015,11(4):16