A Software Architecture for Parallel List Processing on Grids

详细信息    查看全文

• 作者：Apolo H. Hernández (19)
  Graciela Román-Alonso (19)
  Miguel A. Castro-García (19)
  Manuel Aguilar-Cornejo (19)
  Santiago Domínguez-Domínguez (20)
  Jorge Buenabad-Chávez (20)
  
• 关键词：Cluster Computing ; Parallel Computing ; Grid Computing ; Load Balancing ; OpenVPN
• 刊名：Lecture Notes in Computer Science
• 出版年：2012
• 出版时间：2012
• 年：2012
• 卷：7203
• 期：1
• 页码：730-739
• 全文大小：228KB
• 参考文献：1. Globus toolkit (February 2010), http://www.globus.org/
  2. Bruen, A., Dixon, R.: The / n-queens problem. Discrete Mathematics?12, 393-95 (1975) CrossRef
  3. Caromel, D., Delbé, C., di Costanzo, A., Leyton, M.: ProActive: an integrated platform for programming and running applications on grids and P2P systems. Computational Methods in Science and Technology?12(1), 69-7 (2006)
  4. Dean, J., Ghemawat, S.: Mapreduce: Simplifed data processing on large clusters. In: Operating Systems Design and Implementation, pp. 137-49 (2004)
  5. Feilner, M., Graf, N.: Beginning OpenVPN 2.0.9. Build and Integrate Virtual Private Networks Using OpenVPN. Packt Publishing (December 2009)
  6. Leyton, M., Piquer, J.M.: Skandium: Multi-core programming with algorithmic skeletons. In: PDP, pp. 289-96 (2010)
  7. Quintin, J.-N., Wagner, F.: Hierarchical Work-Stealing. In: D’Ambra, P., Guarracino, M., Talia, D. (eds.) Euro-Par 2010. LNCS, vol.?6271, pp. 217-29. Springer, Heidelberg (2010) CrossRef
  8. Santana-Santana, J., Castro-García, M.A., Aguilar-Cornejo, M., Roman-Alonso, G.: Load balancing algorithms with partial information management for the dlml library. In: 2010 18th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), pp. 64-8 (2010)
  9. Tanno, H., Iwasaki, H.: Parallel Skeletons for Variable-Length Lists in SkeTo Skeleton Library. In: Sips, H., Epema, D., Lin, H.-X. (eds.) Euro-Par 2009. LNCS, vol.?5704, pp. 666-77. Springer, Heidelberg (2009) CrossRef
  10. Yagoubi, B., Medebber, M.: A load balancing model for grid environment. In: 22nd International Symposium on Computer and Information Sciences, ISCIS 2007, pp. 268-74. IEEE (2007)
  
• 作者单位：Apolo H. Hernández (19)
  Graciela Román-Alonso (19)
  Miguel A. Castro-García (19)
  Manuel Aguilar-Cornejo (19)
  Santiago Domínguez-Domínguez (20)
  Jorge Buenabad-Chávez (20)
  
  19. Departamento de Ing. Eléctrica, Universidad Autónoma Metropolitana, México, DF., A.P. 55-534, México
  20. Departamento de Computación, Centro de Investigación y de Estudios Avanzados del IPN, México, DF., A.P. 14-740, México
  

文摘

The Data List Management Library (DLML) processes data lists in parallel, balancing the workload transparently to programmers. Programmers only need to organise data into a list, use DLML functions to insert and get data items, and specify the sequential function(s) to process each data item according to the application logic. The first design of DLML was targeted for use at a single cluster. This paper presents DLML-Grid, a software architecture for DLML to run in Grid environments composed of multiple distributed clusters. The architecture is hierarchical and tends to localise communication within clusters, thus reducing communication overhead. Using OpenVPN, we implemented a prototype version of DLML-Grid to gather empirical results on its performance using two clusters and two applications whose workload is static and dynamically generated. DLML-Grid performs much better than DLML overall.