Interoperable execution of eScience applications on Grids & Clouds through open standards (original) (raw)
Related papers
2009
Many production Grid and e-science infrastructures offer their broad range of resources via services to endusers during the past several years with an increasing number of scientific applications that require access to a wide variety of resources and services in multiple Grids. But the vision of worldwide federated Grid infrastructures in analogy to the electrical power Grid is still not seamlessly provided today. This is partly due to the fact, that Grids provide a much more variety of services (job management, data management, data transfer, etc.) in comparison with the electrical power Grid, but also the emerging open standards are still partly to be improved in terms of production usage. This paper points exactly to these improvements with a well-defined design of an infrastructure interoperability reference model that is based on open standards that are refined with experience gained by production Grid interoperability use cases. This contribution gives insights into the core building blocks in general, but focuses significantly on the computing building blocks of the reference model in particular.
Enabling scientific workflow and gateways using the standards-based XSEDE architecture
2017 International Conference on Information and Communication Technologies (ICICT), 2017
The XSEDE project seeks to provide "a single virtual system that scientists can use to interactively share computing resources, data and experience." The potential compute resources in XSEDE are diverse in many dimensions, node architectures, interconnects, memory, local queue management systems, and authentication policies to name a few. The diversity is particularly rich when one considers the NSF funded service providers and the many campuses that wish to participate via campus bridging activities. Resource diversity presents challenges to both application developers and application platform developers (e.g., developers of gateways, portals, and workflow engines). The XSEDE Execution Management Services (EMS) architecture is an instance of the Open Grid Services Architecture EMS and is used by higher level services such as gateways and workflow engines to provide end users with execution services that meet their needs. The contribution of this paper is to provide a concise explanation and concrete examples of how the EMS works, how it can be used to support scientific gateways and workflow engines, and how the XSEDE EMS and other OGSA EMS architectures can be used by applications developers to securely access heterogeneous distributed computing and data resources.
Supporting interoperability of e-science infrastructures with a common information service
2009 First Asian Himalayas International Conference on Internet, 2009
The heterogeneity of Grid resources (e.g. compute, storage, and network) that are geographically dispersed creates a fundamental challenge in terms of their discovery and monitoring process in production Grids today. In order to overcome these challenges, a wide variety of information models and services are developed that provide proprietary solutions in rather complex ways. Many of those services lack simplicity with respect to the setup, resource registration, maintenance, and security, thus making the information system complex and hard to use, especially in Grids driven by High Performance Computing (HPC) needs such as DEISA. In this paper we present a Common Information Service (CIS), which represents an information service, which aims to provide the functionality required to seamlessly aggregate and expose Grid resource information from various heterogeneous resources. The contribution of this paper is about using the emerging OGF GLUE2 standard information model for structuring Grid resource information in order to achieve the interoperability with other Grid technologies in general and other information systems in particular. Using this standard, our contribution provides insights of how CIS publishes and discovers resource and service information in the context of Web services based UNICORE Grids (e.g. DEISA, D-Grid) and highlights example deployments of the D-Mon project. Since the availability of upto-date information is essential for Grid interoperability, we furthermore provide insights of how CIS can be used to contribute to cross-Grid applications based on the Infrastructure Interoperability Reference Model (IIRM).
SIENA: Grid and Cloud Standards for e-Science and beyond
2012
The adoption of open standards-based interoperable grid and cloud computing infrastructure is a way to support research in Europe that can be empowered through ubiquitous, trusted, and easy trans-national access to services for data, computation, communication and collaborative work. SIENA is the European Commission-funded project whose roadmap assesses the situation, identifies issues and makes recommendations on the adoption and evolution of grid and cloud standards for e-science and beyond. These recommendations look to continue the dialogue between public sector officials, industry and Standard Development Organizations over the deployment of cloud based services for the scientific community and public procurement. This paper presents the results of the SIENA roadmap together with its recommendations that are focused on the work of Europe's Distributed Computing Infrastructure initiatives in advancing the standards landscape, especially with regard to the adoption of cloud standards such as OCCI, CDM and OVF.
2002
The growth of the Internet and the advent of the computational Grid have made it possible to develop and deploy advanced computational collaboratories. These systems build on high-end computational resources, communication technologies and enabling services underlying the Grid, and provide seamless and collaborative access to resources, applications and data. Combining these focused collaboratories and allowing them to interoperate has many advantages and can lead to truly collaborative, multidisciplinary and multi-institutional problem solving. However, integrating these collaboratories presents significant challenges, as each of these collaboratories has a unique architecture and implementation, and builds on different enabling technologies. This paper investigates the issues involved in integrating collaboratories operating on the Grid. It then presents the design and implementation of a prototype middleware substrate to enable a peer-to-peer integration of and global access to multiple, geographically distributed instances of the DISCOVER computational collaboratory. An experimental evaluation of the middleware substrate is presented.
NEKTAR, SPICE and Vortonics: Using federated grids for large scale scientific applications
2007
In response to a joint call from US's NSF and UK's EPSRC for applications that aim to utilize the combined computational resources of the US and UK, three computational science groups from UCL, Tufts and Brown Universities teamed up with a middleware team from NIU/Argonne to meet the challenge. Although the groups had three distinct codes and aims, the projects had the underlying common feature that they were comprised of large-scale distributed applications which required high-end networking and advanced middleware in order to be effectively deployed. For example, cross-site runs were found to be a very effective strategy to overcome the limitations of a single resource.
2007
faces provide functionality of major importance. Emerging e-Science and Grid infrastructures such as EGEE and DEISA rely on highly available services that are capable of managing scientific jobs. It is the adoption of emerging open standard interfaces which allows the distribution of Grid resources in such a way that their actual service implementation or Grid technologies are not isolated from each other, especially when these resources are deployed in different e-Science infrastructures that consist of different types of computational resources. This paper motivates the interoperability of these infrastructures and discusses solutions. We describe the adoption of various open standards that recently emerged from the Open Grid Forum (OGF) in the field of job submission and management by well-known Grid technologies, respectively gLite and UNICORE. This has a fundamental impact on the interoperability between these technologies and thus within the next generation e-Science infrastructures that rely on these technologies. Third IEEE International Conference on e-Science and Grid Computing 0-7695-3064-8/07 $25.00