A Meta-Brokering Framework for Science Gateways

详细信息    查看全文

• 作者：Krisztian Karoczkai ; Attila Kertesz ; Peter Kacsuk
• 关键词：Meta ; brokering ; Interoperability ; Distributed infrastructures ; Workflows
• 刊名：Journal of Grid Computing
• 出版年：2016
• 出版时间：December 2016
• 年：2016
• 卷：14
• 期：4
• 页码：687-703
• 全文大小：
• 刊物类别：Computer Science
• 刊物主题：Processor Architectures; Management of Computing and Information Systems; User Interfaces and Human Computer Interaction;
• 出版者：Springer Netherlands
• ISSN：1572-9184
• 卷排序：14

文摘

Recently scientific communities produce a growing number of computation-intensive applications, which calls for the interoperation of distributed infrastructures including Clouds, Grids and private clusters. The European SHIWA and ER-flow projects have enabled the combination of heterogeneous scientific workflows, and their execution in a large-scale system consisting of multiple Distributed Computing Infrastructures. One of the resource management challenges of these projects is called parameter study job scheduling. A parameter study job of a workflow generally has a large number of input files to be consumed by independent job instances. In this paper we propose a meta-brokering framework for science gateways to support the execution of such workflows. In order to cope with the high uncertainty and unpredictable load of the utilized distributed infrastructures, we introduce the so called resource priority services. These tools are capable of determining and dynamically updating priorities of the available infrastructures to be selected for job instances. Our evaluations show that this approach implies an efficient distribution of job instances among the available computing resources resulting in shorter makespan for parameter study workflows.