基于Intel Nehalem-ep服务器主板的设计与研究
摘要
刀片服务器是一种HAHD(High Availability High Density,高可用高密度)服务器平台,是专门为特殊应用行业和高密度计算机环境设计的,其中每一块“刀片”实际上就是一块系统“主板”,它们可以通过“板载”硬盘启动自己的操作系统。管理员可以使用系统软件将这些母板集合成一个服务器集群,共享资源。在集群模式下,所有的母板可以连接起来提供高速的网络环境,并同时共享资源,为相同的用户群服务。在集群中插入新的“刀片”,就可以提高整体性能。而由于每块“刀片”都是热插拔的,所以,系统可以轻松地进行替换,并且将维护时间减少到最小。这些刀片服务器具有低功耗、空间小、单机售价低等特点。这些设计满足了密集计算环境对服务器性能的需求,有的还通过内置的负载均衡技术,有效地提高了服务器的稳定性和核心网络性能。刀片服务器能够最大限度地节约服务器的使用空间和费用,并为用户提供灵活、便捷的扩展升级手段。
本文详细介绍了一种基于Intel公司2009年第一季度最新发行的QuickPath架构四核Nehalem-ep处理器和Tylersburg 36D、ICH10芯片组的刀片的系统和硬件设计。刀片作为下一代商用高性能服务器的主板,主要具有三个方面的功能:处理功能、接口功能以及主板管理功能。
本文在介绍该刀片服务器主板的硬件设计之外,也对该主板上的高速信号的信号完整性问题做了详细分析,并且也对该主板在PCB布局布线、生产加工工艺上应注意的问题进行了详尽分析。
按照论文中提出的设计方案,成功地生产出和调试通了该主板,并完成了各项性能测试,对开发下一代高性能刀片服务器具有普遍的意义。最后论文针对所设计的主板,对国内外整个刀片服务器现状做了总结和分析,并对服务器行业的发展前景作了展望。
Blade server is a HAHD (High Availability High Density, high-availability high-density) server platform, designed for apecial application industry and high-density computer environments. Each piece of "blade" is actually a system mainboard, they can use the "onboard" hard disk to start their own operating system. Administrator can integrate these mainboards to a server cluster to share resource by using some system Software. In the cluster mode, all of the mainboard can be connected together to provide high-speed network environment, while sharing resources, serving for the users. We can improve the overall performance by inserting a new "blades" into the cluster. Since each "blades" are hot-plug, so the system can easily be replaced, and the maintenance time will be reduced to a minimum. These blade servers have much excellent features such as low power consumption, small space occupation, low price for each single device and so on.These design are able to meet the requirements of intensive computing environments on the server performance needs. Some can even effectively improve the stability of the server and core network performance through the built-in load balancing technology. Blade server can maximize the use of saving server space and costs, and provide users with flexible, convenient ways of extension or upgrade.
This paper describes a hardware design of the blade server mainboard based on Intel Nehalem-ep quad-core processors and the Tylersburg 36D, ICH10 Chipset which will be first release at the first quarter of 2009.The board will be used for the next generation of high-performance commercial blade server mainboard and have the following three aspects functions: processing functions, interface functions and board management functions.
This paper have also focused on the high-speed signal integrity on the board and what problems we should pay attention to in the PCB layout, production and processing technology in detail.
We have succeeded in producing and debugging the mainboard, and completed the performance test for the board following the design in the paper. These may have universal significance for developing the next generation high-performance server board. In the end of paper, we have made a summary and analysis towards the blade mainboard which we designed and the current situation of the entire blade server at home and abroad, and and also points out the prospects for development of server industry.
本文详细介绍了一种基于Intel公司2009年第一季度最新发行的QuickPath架构四核Nehalem-ep处理器和Tylersburg 36D、ICH10芯片组的刀片的系统和硬件设计。刀片作为下一代商用高性能服务器的主板,主要具有三个方面的功能:处理功能、接口功能以及主板管理功能。
本文在介绍该刀片服务器主板的硬件设计之外,也对该主板上的高速信号的信号完整性问题做了详细分析,并且也对该主板在PCB布局布线、生产加工工艺上应注意的问题进行了详尽分析。
按照论文中提出的设计方案,成功地生产出和调试通了该主板,并完成了各项性能测试,对开发下一代高性能刀片服务器具有普遍的意义。最后论文针对所设计的主板,对国内外整个刀片服务器现状做了总结和分析,并对服务器行业的发展前景作了展望。
Blade server is a HAHD (High Availability High Density, high-availability high-density) server platform, designed for apecial application industry and high-density computer environments. Each piece of "blade" is actually a system mainboard, they can use the "onboard" hard disk to start their own operating system. Administrator can integrate these mainboards to a server cluster to share resource by using some system Software. In the cluster mode, all of the mainboard can be connected together to provide high-speed network environment, while sharing resources, serving for the users. We can improve the overall performance by inserting a new "blades" into the cluster. Since each "blades" are hot-plug, so the system can easily be replaced, and the maintenance time will be reduced to a minimum. These blade servers have much excellent features such as low power consumption, small space occupation, low price for each single device and so on.These design are able to meet the requirements of intensive computing environments on the server performance needs. Some can even effectively improve the stability of the server and core network performance through the built-in load balancing technology. Blade server can maximize the use of saving server space and costs, and provide users with flexible, convenient ways of extension or upgrade.
This paper describes a hardware design of the blade server mainboard based on Intel Nehalem-ep quad-core processors and the Tylersburg 36D, ICH10 Chipset which will be first release at the first quarter of 2009.The board will be used for the next generation of high-performance commercial blade server mainboard and have the following three aspects functions: processing functions, interface functions and board management functions.
This paper have also focused on the high-speed signal integrity on the board and what problems we should pay attention to in the PCB layout, production and processing technology in detail.
We have succeeded in producing and debugging the mainboard, and completed the performance test for the board following the design in the paper. These may have universal significance for developing the next generation high-performance server board. In the end of paper, we have made a summary and analysis towards the blade mainboard which we designed and the current situation of the entire blade server at home and abroad, and and also points out the prospects for development of server industry.
引文
[1]Jamieson,Stuart.ATCA/MicroTCA chassis systems for networking.New York:Electronic Products.Hearst Business Communications,Uniondale,NY 11553,United States..November 2008.
[2]李佳,傅红.HP BladeSystem刀片服务器在美国航空业中的应用.北京:中国石油和化工出版社,2008年17期.
[3]Desai Dhruv,Bradicich Thomas,Champion David,Holland William,Kreuz Benjamin.BladeCenter system overview.IBM Journal of Research and Development,November 2005.
[4]Smith Earl,Trivedi Kishor,Tomek Lorrie,Ackaret Jerry.Availability analysis of blade server systems.IBM Systems Journal,2008.
[5]Garza John,Brantley Matthew,Strickland Travis.High density blade server enclosure with hot-swap capability.Research Disclosure.IBM Corporation,Yorktown Heights,New York,NY 10598,United States,May 2006.
[6]程妙玉.英特尔酷睿微体系架构与浪潮服务器.济南:科技浪潮,2006年05期.
[7]LUO Yu-feng,JIN Jie.Analysis of the Assemblage Architecture of High Computing Density Servers.School of Computer Science;National University of Defense and Technology;Changsha 410073;China.
[8]周建辉,杨舂信.CPU散热器结构设计与热分析[J].电子机械工程,2006,(06).
[9]Sun推出基于AMD四核皓龙处理器的新产品[J].信息网络安全,2008,(06).
[10]张威.联想45纳米四核服务器亮相.北京:微型机与应用,2008年03期.
[11]英特尔展示32nm芯片及下一代Nehalem微处理器架构[J].电子设计应用,2007,(10).
[12]赵吉志.新一代Nehalem处理器技术及浪潮服务器的应用.科技浪潮,2009年02期.
[13]Aoki Michihiro,Habara Keishi,Hamano Takafumi,Ogawa Kentaro,Chaki Shinichiro.ATCA-based open-architecture router prototype.IEICE Transactions on Communications.Oxford University Press,May 2006.
[14]Dong zhi-zhong,Meng meng,Liang zhan-peng,Peng xiao-feng(Department of thermal engineering;Tsinghua university;Beijing 100084;china).Thermal performance of ATCA mainboard with different heat sink materials.Beijing;Journal of engineering thermophysics,2008-03.
[15]赵吉志.新一代Nehalem处理器技术及浪潮服务器的应用[J].科技浪潮,2009,(02).
[16]闫冬.英特尔Nehalem变内存直联架构 新架构订处理器较上一代酷睿速度提升近一半[J].每周电脑报,2008,(37).
[17]方正电脑公司服务器产品部.IA架构服务器的主板控制芯片组.北京:信息系统工程,2000年10期.
[18]王树佳.浪潮服务器主板设计中USB信号测量技术.济南:科技浪潮.2007年06期.
[19]LSI公司与Intel宣布扩展SAS/SATA RAID合作协议[J].计算机与网络,2007,(23).
[20]Qiu Shan Qin,Wang Chang,Zyu.Analysis of Blade Server Technology and Standards.Beijing:Journal of Engineering Thermophysics,2008-03.
[21]宋晓峰.解析SAS的I/O性能[J].科技浪潮,2007,(04).
[22]张神唐.RAID技术在服务器中的应用.潜江:江汉石油科技,2006年02期.
[23]Tsuneya Akira.New management technologies for blade servers.Fujitsu Scientific and Technical Journal:Emerging Middleware Technologies,2006-06.
[24]董志忠,孟勐,梁展鹏,彭晓峰.散热模块材料对ATCA主板散热性能影响研究.北京:工程热物理学报,2008年03期.
[25]黎美,刘笃仁.基于USB2.0的接口芯片ISP1581的应用与设计[J].北京:中国集成电路,2005-07:55-59.
[26]Barker Kevin,Davis Keil,Hoisie Adolfy,Kerbyson Darren,Lang Mike,Pakin Scott,Sancho Jose Carlos.A performance evaluation of the Nehalem quad-core processor for scientific computing.Parallel Processing Letters,Pages:453-469,December 2008.
[27]IBM Systems Technology Group,Ansoft Corporation.Effective resolution of design issues in telecommunication blade systems.Electrical Performance of Electronic Packaging,EPEP 2008.
[28]Hughes James,Scollard Michael,Land Rudolf,Parsonese James,West Christopher,Stankevich Victor,Purrington Challis,Hoang Danny,Shippy Gary,Loeb Mitchell,Williams Mark W,Smith Bruce,Desai Dhruv.BladeCenter processor blades,I/O expansion adapters,and units.IBM Journal of Research and Development,November 2005
[29]Wong William.AdvancedTCA platform delivers blade-server modularity.Electronic Design,November 29,2004.
[30]贾飞,董浩斌.基于USB2.0接口的PC主板电源测试系统.北京:计算机工程与设计,2009年10期.
[31]王凤禄.SAS通道技术[J].石家庄:计算机与网络,2008,(17).
[32]Kurd Nasser,Douglas Jonathan,Mosalikanti Praveen,Kumar Rajesh.Next generation Intel micro-architecture(Nehalem) clocking architecture.IEEE Symposium on VLSI Circuits,Digest of Technical Papers,56-57,2008.
[33]Shin Dong-Beom,Kim Dae-Young.A design and implelnentation of ATCA based EPON blade.COIN-NGNCON 2006:The Joint International Conference on Optical Internet and Next Generation Network,July 9,2006-July 13,2006.
[34]王树佳.服务器主板的处理器VRM优化设计.济南:科技浪潮.2007年08期.
[35]孙宇贞.高速电路的信号完整性分析.北京:电子技术应用,2005年03期.
[36]王卿,崔海蒸.高速电路设计中的信号完整性分析.西安:电子元器件应用,2008年03期.
[37]张斌,张松涛,葛晓琦.高速电路设计方法.石家庄:计算机与网络,2007年02期.
[38]黄德勇,张扬.高速电路设计中的信号完整性研究.成都:电讯技术,2004年02期.
[39]Wang Xin,Wang zhi zhong.Terminal-Matching Technique in High-Speed Board Design,2005-07.
[40]Zhang Huan,Chen Jian(Hefei University of Technology;Institute of Sound and Vibration Research;Hefei 230009;china).Technical Acoustics,2008-04.
[41]Xiao Dong Wang.Design and Signal Integrity Analysis of Universal Server Mainboard Based of PPC750,2003-07.
[42]李响.高速电路设计中的串扰问题及对策.广州:电子质量.2002年04期.
[43]王丽英.高速串行技术带来测试新挑战.北京:今日电子,2008年05期.
[44]Shi Wei Shang.High-Speed Circuit Design and the Application for Board Circuit,2008-05-22.
[45]Chen Yabin,Guo Yong(Air Force Engineering University;Xian;710038).Several Advisements on High Speed Circuit,2002-02.
[46]张磊,雷震,刘海波,林哲辉.高速电路设计和信号完整性分析.北京:电子技术应用,2001年06期.
[47]Zhou Xin.Table Model Computer Mainboard Signal Integrity(SI) Examination Method Design and Application,2007-11-02.
[48]粟立军.新型低成本无铅兼容FR-4覆铜板的开发.咸阳:覆铜板资讯,2008年06期.
[49]周志近.波峰焊工艺及常见问题分析.北京:现代显示,2009年02期.
[50]鲜飞.波峰焊接工艺技术的研究.北京:电子工业专用设备,2009年02期.
[51]Mutnury Bhyrav,Pham Nam,Cases Moises,De Araujo Daniel,Pitner Greg.Design issues in telecommunication blade systems and their resolution through design of experiments,2009 59th Electronic Components and Technology Conference,ECTC 2009.
[2]李佳,傅红.HP BladeSystem刀片服务器在美国航空业中的应用.北京:中国石油和化工出版社,2008年17期.
[3]Desai Dhruv,Bradicich Thomas,Champion David,Holland William,Kreuz Benjamin.BladeCenter system overview.IBM Journal of Research and Development,November 2005.
[4]Smith Earl,Trivedi Kishor,Tomek Lorrie,Ackaret Jerry.Availability analysis of blade server systems.IBM Systems Journal,2008.
[5]Garza John,Brantley Matthew,Strickland Travis.High density blade server enclosure with hot-swap capability.Research Disclosure.IBM Corporation,Yorktown Heights,New York,NY 10598,United States,May 2006.
[6]程妙玉.英特尔酷睿微体系架构与浪潮服务器.济南:科技浪潮,2006年05期.
[7]LUO Yu-feng,JIN Jie.Analysis of the Assemblage Architecture of High Computing Density Servers.School of Computer Science;National University of Defense and Technology;Changsha 410073;China.
[8]周建辉,杨舂信.CPU散热器结构设计与热分析[J].电子机械工程,2006,(06).
[9]Sun推出基于AMD四核皓龙处理器的新产品[J].信息网络安全,2008,(06).
[10]张威.联想45纳米四核服务器亮相.北京:微型机与应用,2008年03期.
[11]英特尔展示32nm芯片及下一代Nehalem微处理器架构[J].电子设计应用,2007,(10).
[12]赵吉志.新一代Nehalem处理器技术及浪潮服务器的应用.科技浪潮,2009年02期.
[13]Aoki Michihiro,Habara Keishi,Hamano Takafumi,Ogawa Kentaro,Chaki Shinichiro.ATCA-based open-architecture router prototype.IEICE Transactions on Communications.Oxford University Press,May 2006.
[14]Dong zhi-zhong,Meng meng,Liang zhan-peng,Peng xiao-feng(Department of thermal engineering;Tsinghua university;Beijing 100084;china).Thermal performance of ATCA mainboard with different heat sink materials.Beijing;Journal of engineering thermophysics,2008-03.
[15]赵吉志.新一代Nehalem处理器技术及浪潮服务器的应用[J].科技浪潮,2009,(02).
[16]闫冬.英特尔Nehalem变内存直联架构 新架构订处理器较上一代酷睿速度提升近一半[J].每周电脑报,2008,(37).
[17]方正电脑公司服务器产品部.IA架构服务器的主板控制芯片组.北京:信息系统工程,2000年10期.
[18]王树佳.浪潮服务器主板设计中USB信号测量技术.济南:科技浪潮.2007年06期.
[19]LSI公司与Intel宣布扩展SAS/SATA RAID合作协议[J].计算机与网络,2007,(23).
[20]Qiu Shan Qin,Wang Chang,Zyu.Analysis of Blade Server Technology and Standards.Beijing:Journal of Engineering Thermophysics,2008-03.
[21]宋晓峰.解析SAS的I/O性能[J].科技浪潮,2007,(04).
[22]张神唐.RAID技术在服务器中的应用.潜江:江汉石油科技,2006年02期.
[23]Tsuneya Akira.New management technologies for blade servers.Fujitsu Scientific and Technical Journal:Emerging Middleware Technologies,2006-06.
[24]董志忠,孟勐,梁展鹏,彭晓峰.散热模块材料对ATCA主板散热性能影响研究.北京:工程热物理学报,2008年03期.
[25]黎美,刘笃仁.基于USB2.0的接口芯片ISP1581的应用与设计[J].北京:中国集成电路,2005-07:55-59.
[26]Barker Kevin,Davis Keil,Hoisie Adolfy,Kerbyson Darren,Lang Mike,Pakin Scott,Sancho Jose Carlos.A performance evaluation of the Nehalem quad-core processor for scientific computing.Parallel Processing Letters,Pages:453-469,December 2008.
[27]IBM Systems Technology Group,Ansoft Corporation.Effective resolution of design issues in telecommunication blade systems.Electrical Performance of Electronic Packaging,EPEP 2008.
[28]Hughes James,Scollard Michael,Land Rudolf,Parsonese James,West Christopher,Stankevich Victor,Purrington Challis,Hoang Danny,Shippy Gary,Loeb Mitchell,Williams Mark W,Smith Bruce,Desai Dhruv.BladeCenter processor blades,I/O expansion adapters,and units.IBM Journal of Research and Development,November 2005
[29]Wong William.AdvancedTCA platform delivers blade-server modularity.Electronic Design,November 29,2004.
[30]贾飞,董浩斌.基于USB2.0接口的PC主板电源测试系统.北京:计算机工程与设计,2009年10期.
[31]王凤禄.SAS通道技术[J].石家庄:计算机与网络,2008,(17).
[32]Kurd Nasser,Douglas Jonathan,Mosalikanti Praveen,Kumar Rajesh.Next generation Intel micro-architecture(Nehalem) clocking architecture.IEEE Symposium on VLSI Circuits,Digest of Technical Papers,56-57,2008.
[33]Shin Dong-Beom,Kim Dae-Young.A design and implelnentation of ATCA based EPON blade.COIN-NGNCON 2006:The Joint International Conference on Optical Internet and Next Generation Network,July 9,2006-July 13,2006.
[34]王树佳.服务器主板的处理器VRM优化设计.济南:科技浪潮.2007年08期.
[35]孙宇贞.高速电路的信号完整性分析.北京:电子技术应用,2005年03期.
[36]王卿,崔海蒸.高速电路设计中的信号完整性分析.西安:电子元器件应用,2008年03期.
[37]张斌,张松涛,葛晓琦.高速电路设计方法.石家庄:计算机与网络,2007年02期.
[38]黄德勇,张扬.高速电路设计中的信号完整性研究.成都:电讯技术,2004年02期.
[39]Wang Xin,Wang zhi zhong.Terminal-Matching Technique in High-Speed Board Design,2005-07.
[40]Zhang Huan,Chen Jian(Hefei University of Technology;Institute of Sound and Vibration Research;Hefei 230009;china).Technical Acoustics,2008-04.
[41]Xiao Dong Wang.Design and Signal Integrity Analysis of Universal Server Mainboard Based of PPC750,2003-07.
[42]李响.高速电路设计中的串扰问题及对策.广州:电子质量.2002年04期.
[43]王丽英.高速串行技术带来测试新挑战.北京:今日电子,2008年05期.
[44]Shi Wei Shang.High-Speed Circuit Design and the Application for Board Circuit,2008-05-22.
[45]Chen Yabin,Guo Yong(Air Force Engineering University;Xian;710038).Several Advisements on High Speed Circuit,2002-02.
[46]张磊,雷震,刘海波,林哲辉.高速电路设计和信号完整性分析.北京:电子技术应用,2001年06期.
[47]Zhou Xin.Table Model Computer Mainboard Signal Integrity(SI) Examination Method Design and Application,2007-11-02.
[48]粟立军.新型低成本无铅兼容FR-4覆铜板的开发.咸阳:覆铜板资讯,2008年06期.
[49]周志近.波峰焊工艺及常见问题分析.北京:现代显示,2009年02期.
[50]鲜飞.波峰焊接工艺技术的研究.北京:电子工业专用设备,2009年02期.
[51]Mutnury Bhyrav,Pham Nam,Cases Moises,De Araujo Daniel,Pitner Greg.Design issues in telecommunication blade systems and their resolution through design of experiments,2009 59th Electronic Components and Technology Conference,ECTC 2009.