Towards Unification of Accelerated Computing and Interconnection For Extreme-Scale Computing

详细信息    查看全文

• 作者：Toshihiro Hanawa (17)
  Yuetsu Kodama (18)
  Taisuke Boku (18)
  Hideharu Amano (19)
  Hitoshi Murai (20)
  Masayuki Umemura (18)
  Mitsuhisa Sato (18)
  
  17. Information Technology Center ; The University of Tokyo ; Kashiwa ; Japan
  18. Center for Computational Sciences ; University of Tsukuba ; Tsukuba ; Japan
  19. Department of Information and Computer Science ; Keio University ; Yokohama ; Japan
  20. RIKEN Advanced Institute for Computational Science ; Kobe ; Japan
  
• 关键词：Accelerator computing ; Interconnection network ; PCI express ; Remote DMA ; GPU direct
• 刊名：Lecture Notes in Computer Science
• 出版年：2015
• 出版时间：2015
• 年：2015
• 卷：9040
• 期：1
• 页码：463-474
• 全文大小：1,962 KB
• 参考文献：1. OpenACC. http://www.openacc-standard.org
  2. PGAS - Partitioned Global Address Space Languages. http://www.pgas.org
  3. QUDA - A Library for QCD on GPUs. http://lattice.github.io/quda/
  4. XcalableMP Specification Version 1.2, November 2012. http://www.xcalablemp.org/spec/xmp-spec-1.2.pdf
  5. Altera Corp.: Stratix IV Device Handbook. http://www.altera.co.jp/literature/lit-stratix-iv.jsp
  6. Amano, H., Kuhara, T., Kaneda, T., Hanawa, T., Kodama, Y., Boku, T.: A preliminarily evaluation of PEACH3: a switching hub for tightly coupled accelerators. In: Proc. of 2nd International Workshop on Computer Systems and Architectures (CSA 2014), in Conjunction with the 2nd International Symposium on Computing and Networking (CANDAR 2014), December 2014
  7. Ammendola, R., et al.: APEnet+: high bandwidth 3D torus direct network for petaflops scale commodity clusters. Journal of Physics 331(Part 5) (2011)
  8. Clark, MA, Babich, R, Barros, K, Brower, RC, Rebbi, C (2010) Solving lattice QCD systems of equations using mixed precision solvers on GPUs. Comput. Phys. Commun. 181: pp. 1517-1528 CrossRef
  9. Dongarra, J., Meuer, H., Stromaier, E., Simon, H.: Top500 list. http://www.top500.org
  10. Feng, W.C., Cameron, K.W.: Green500 list. http://www.green500.org
  11. Fujita, N, Fujii, H, Hanawa, T, Kodama, Y, Boku, T, Kuramashi, Y, Clark, M QCD library for GPU cluster with proprietary interconnect for GPU direct communication. In: Lopes, L eds. (2014) Euro-Par 2014: Parallel Processing Workshops. Springer, Heidelberg, pp. 251-262 CrossRef
  12. Gudmundson, J.: Enabling multi-host system designs with PCI Express technology, May 2004. http://www.plxtech.com/products/expresslane/techinfo
  13. Hanawa, T., Kodama, Y., Boku, T., Sato, M.: Interconnect for tightly coupled accelerators architecture. In: Proc. of IEEE 21st Annual Sympsium on High-Performance Interconnects (HOT Interconnects 21), pp. 79鈥?2, August 2013
  14. Hanawa, T., Kodama, Y., Boku, T., Sato, M.: Tightly coupled accelerators architecture for minimizing communication latency among accelerators. In: The Third International Workshop on Accelerators and Hybrid Exascale Systems (AsHES2013) in Conjunction with IPDPS, pp. 1030鈥?039, May 2013
  15. Kodama, Y, Hanawa, T, Boku, T, Sato, M (2014) PEACH2: FPGA based PCIe network device for tightly coupled accelerators. ACM SIGARCH Computer Architecture News 42: pp. 3-8 CrossRef
  16. Mellanox Technologies: Mellanox OFED GPUDirect. http://www.mellanox.com/content/pages.php?pg=products_dyn&product_family=116&menu_section=34
  17. Nakao, M., Lee, J., Boku, T., Sato, M.: Productivity and performance of global-view programming with XcalableMP PGAS language. In: The 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2012), pp. 402鈥?09, May 2012
  18. Nakao, M., Murai, H., Shimosaka, T., Tabuchi, A., Hanawa, T., Kodama, Y., Boku, T., Sato, M.: XcalableACC: extension of XcalableMP PGAS language using OpenACC for accelerator clusters. In: Proc. of Workshop on a Accelerator Programming Using Directives (WACCPD 2014), in Conjunction with SC14, pp. 27鈥?6, November 2014
  19. NVIDIA Corp.: Developing A Linux Kernel Module Using RDMA For GPUDirect. http://developer.download.nvidia.com/compute/cuda/5_0/rc/docs/GPUDirect_RDMA.pdf
  20. NVIDIA Corp.: NVIDIA GPUDirect. http://developer.nvidia.com/gpudirect
  21. PCI-SIG: PCI Express Card Electromechanical (CEM) Specification, Rev. 2.0, April 2007
  22. PCI-SIG: PCI Express Base Specification, Rev. 3.0, November 2010
  23. Rossetti, D., et al.: Leveraging NVIDIA GPUDirect on APEnet+ 3D torus cluster interconnect, May 2012. http://developer.download.nvidia.com/GTC/PDF/GTC2012/PresentationPDF/S0282-GTC2012-GPU-Torus-Cluster.pdf
  
• 作者单位：Applied Reconfigurable Computing
• 丛书名：978-3-319-16213-3
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence and Robotics
  Computer Communication Networks
  Software Engineering
  Data Encryption
  Database Management
  Computation by Abstract Devices
  Algorithm Analysis and Problem Complexity
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1611-3349

文摘

Heterogeneous clusters using accelerators are widely used for high-performance computing system. In such systems, the inter-node communication among accelerators becomes bottleneck due to the data transfer between the accelerator and the host. To eliminate this overhead, we have been developing a novel communication system realizing direct communication among accelerators over computation nodes under the HA-PACS (Highly Accelerated Parallel Advanced system for Computational Sciences) project. Also we are investigating high-level parallel programming language, and several practical application programs on our concept, as well as studying the enhancement of TCA and developing system software stack in the CREST project.