Gregor Von Laszewski - Academia.edu (original) (raw)
Papers by Gregor Von Laszewski
Future Generation Computer Systems, Jul 1, 2023
In this paper, we describe a service oriented architecture and Grid abstraction framework that al... more In this paper, we describe a service oriented architecture and Grid abstraction framework that allows us to access Grids through JavaScript. Obviously, such a framework integrates well with other Web 2.0 technologies. The framework consists of two parts. A client Application Programming Interface (API) to access the Grid via JavaScript and a mediator service and API through which the Grid access is channeled. The framework uses commodity Web service standards and provides extended functionality such as ...
arXiv (Cornell University), Oct 30, 2022
In this paper, we summarize our effort to create and utilize a simple framework to coordinate com... more In this paper, we summarize our effort to create and utilize a simple framework to coordinate computational analytics tasks with the help of a workflow system. Our design is based on a minimalistic approach while at the same time allowing to access computational resources offered through the owner's computer, HPC computing centers, cloud resources, and distributed systems in general. The access to this framework includes a simple GUI for monitoring and managing the workflow, a REST service, a command line interface, as well as a Python interface. The resulting framework was developed for several examples targeting benchmarks of AI applications on hybrid compute resources and as an educational tool for teaching scientists and students sophisticated concepts to execute computations on resources ranging from a single computer to many thousands of computers as part of on-premise and cloud infrastructure. We demonstrate the usefulness of the tool on a number of examples. The code is available as an open-source project in GitHub and is based on an easy-to-enhance tool called cloudmesh. CCS Concepts: • Computer systems organization → Distributed architectures; Cloud computing; • Software and its engineering → Distributed systems organizing principles.
arXiv (Cornell University), Oct 8, 2020
The COVID-19 pandemic has profound global consequences on health, economic, social, political, an... more The COVID-19 pandemic has profound global consequences on health, economic, social, political, and almost every major aspect of human life. Therefore, it is of great importance to model COVID-19 and other pandemics in terms of the broader social contexts in which they take place. We present the architecture of AICov, which provides an integrative deep learning framework for COVID-19 forecasting with population covariates, some of which may serve as putative risk factors. We have integrated multiple different strategies into AICov, including the ability to use deep learning strategies based on LSTM and even modeling. To demonstrate our approach, we have conducted a pilot that integrates population covariates from multiple sources. Thus, AICov not only includes data on COVID-19 cases and deaths but, more importantly, the population's socioeconomic, health and behavioral risk factors at a local level. The compiled data are fed into AICov, and thus we obtain improved prediction by integration of the data to our model as compared to one that only uses case and death data.
Common finctions to simplify the immplementation of a command shell such as CMD5 in python
Practice and Experience in Advanced Research Computing, Jul 17, 2021
The United States science and engineering community faces multiple challenges related to funding ... more The United States science and engineering community faces multiple challenges related to funding and funding policies for science and engineering. A framework is needed to evaluate the impact of scientific facilities and instruments. In this paper, we demonstrate such an activity through our comprehensive work evaluating the scientific impact of XSEDE using the Semantic Scholar Data. In contrast to other studies, our study includes the bibliographic references of all recorded papers related to XSEDE over the entire performance period till March of 2021. This makes this study unique and distinguishes it from our earlier work while using (a) over 180 million papers as a comparison to our peer analysis, (b) include all publications reported, and (c) conduct the study repeatedly over several years.
![Research paper thumbnail of Peer comparison of XSEDE and NCAR publication data [manuscript]](https://attachments.academia-assets.com/118973574/thumbnails/1.jpg)
](We present a framework that compares the publication impact based on a comprehensive peer analysi... more We present a framework that compares the publication impact based on a comprehensive peer analysis of papers produced by scientists using XSEDE and NCAR resources. The analysis is introducing a percentile ranking based approach of citations of the XSEDE and NCAR papers compared to peer publications in the same journal that do not use these resources. This analysis is unique in that it evaluates the impact of the two facilities by comparing the reported publications from them to their peers from within the same journal issue. From this analysis, we can see that papers that utilize XSEDE and NCAR resources are cited statistically significantly more often. Hence we find that reported publications indicate that XSEDE and NCAR resources exert a strong positive impact on scientific research.
Concurrency and Computation: Practice and Experience, Apr 17, 2011
Electronic Health Records (EHRs) have many potential advantages over traditional paper records, s... more Electronic Health Records (EHRs) have many potential advantages over traditional paper records, such as wide scale access, error checking, and protection from physical damage to a record. As with any medical record, paper or electronic, both the patient's privacy and the document's integrity must be guaranteed. With initiatives such as Integrating the Healthcare Enterprise (IHE), computerized healthcare systems are able to share EHRs on a large scale, while protecting the patient's privacy rights. However, IHE does not yet meet the needs for all healthcare systems, as we will show with the eMOLST project. The eMOLST project delivers software in support of Medical Order for Life Sustaining Treatment (MOLST) forms and uses IHE specifications for cross enterprise document storage and sharing, patient identification, and user authentication & authorization. The Web based system provides secure access to electronic MOLST documents regardless of the patient's or healthcare provider's location. The eMOLST project allows a user to have Single Sign On (SSO) access to the system from either the user's associated enterprise, or through a Web portal shared amongst all users across all enterprises. In this paper, we show a security solution to allow SSO from multiple access points for IHE compliant systems.
We present the design of a toolkit that can be employed by users and administrators to manage vir... more We present the design of a toolkit that can be employed by users and administrators to manage virtual machines on multi-cloud environments. It can be run by individual users or offered as a service to a shared user community. We have practically demonstrated its use as part of a Future-Grid service, allowing users of FutureGrid to utilize such a service. Furthermore, we discuss implications and solutions for a unified metrics system assisting the users to find and utilize resources appropriate for their applications. Lastly, we discuss how to move such a multi-cloud environment forward by integrating clouds managed by the community or are offered as public clouds. This includes the introduction of a mutual trust agreement on a user and project basis. We have developed a number of components that support the creation of such a multi-cloud environment. This system is known as Cloudmesh and has been used in practice to achieve virtual machine management in multiple clouds. An important distinguishing factor of Cloudmesh is that it also allows the use of bare metal provisioning for supporting service providers and authorized users, offering services beyond those available by typical clouds.
In recent years the power of Grid computing has grown exponentially through the development of ad... more In recent years the power of Grid computing has grown exponentially through the development of advanced middleware systems. While usage has increased, the penetration of Grid computing in the scientific community has been less than expected by some. This is due to a steep learning curve and high entry barrier that limit the use of Grid computing and advanced cyberinfrastructure. In order for the scientists to focus on actual scientific tasks, specialized tools and services need to be developed to ease the integration of complex middleware. Our solution is Cyberaide Shell, an advanced but simple to use system shell which provides access to the powerful cyberinfrastructure available today. Cyberaide Shell provides a dynamic interface that allows access to complex cyberinfrastructure in an easy and intuitive fashion on an ad-hoc basis. This is accomplished by abstracting the complexities of resource, task, and application management through a scriptable command line interface. Through a service integration mechanism, the shell's functionality is exposed to a wide variety of frameworks and programming languages. Cyberaide Shell includes specialized experiment management and workflow commands that, with the scriptable nature of a shell, provide a set of services which where previously unavailable. The usability of Cyberaide Shell is demonstrated using a Water Threat Management application deployed on the TeraGrid.
Cloud computing has become an important driver for delivering infrastructure as a service (IaaS) ... more Cloud computing has become an important driver for delivering infrastructure as a service (IaaS) to users with on-demand requests for customized environments and sophisticated software stacks. Within the FutureGrid (FG) project, we offer different IaaS frameworks as well as high performance computing infrastructures by allowing users to explore them as part of the FG testbed. To ease the use of these infrastructures, as part of performance experiments, we have designed an image management framework, which allows us to create user defined software stacks based on abstract image management and uniform image registration. Consequently, users can create their own customized environments very easily. The complex processes of the underlying infrastructures are managed by our sophisticated software tools and services. Besides being able to manage images for IaaS frameworks, we also allow the registration and deployment of images onto bare-metal by the user. This level of functionality is typically not offered in a HPC (high performance computing) infrastructure. However, our approach provides users with the ability to create their own environments changing the paradigm of administrator-controlled dynamic provisioning to user-controlled dynamic provisioning, which we also call raining. Thus, users obtain access to a testbed with the ability to manage state-of-the-art software stacks that would otherwise not be supported in typical compute centers. Security is also considered by vetting images before they are registered in a infrastructure. In this paper, we present the design of our image management framework and evaluate two of its major components. This includes the image creation and image registration. Our design and implementation can support the current FG user community interested in such capabilities.
Abstract—FutureGrid (FG) is an experimental, highperformance testbed that support HPC, cloud and ... more Abstract—FutureGrid (FG) is an experimental, highperformance testbed that support HPC, cloud and grid computing experiments for both applications and computer science. FutureGrid will employ virtualization technology to allow the testbed to support a wide range of operating systems. Therefore, the efficient management of virtual machine images (from now on called images) becomes a key issue. Current cloud frameworks do not provide a way to manage images for different frameworks. That is, they have their own image ...
Civil-comp proceedings, Mar 16, 2011
We present a workflow-based algorithm for identifying threads to an urban water management system... more We present a workflow-based algorithm for identifying threads to an urban water management system. Through Grid computing we provide the necessary high-performance computing resources to deliver quickly solutions to the problem. We prototyped a new middleware called cyberaide, that enables easy access to Grid resources through portals or the command line. A workflow system is used to manage resources in fault tolerant fashion. In addition, we contrast the architecture with a Hadoop implementation. Resources from TeraGrid and FutureGrid are used to test the feasibility of using the toolkit for a scientific application.
Workflow management is an important part of scientific experiments. A common pattern that scienti... more Workflow management is an important part of scientific experiments. A common pattern that scientists are using is based on repetitive job execution on a variety of different systems, and managing such job execution is necessary for large-scale scientific workflows. The workflow system should also be client-based and able to handle multiple security contexts to allow researchers to take advantage of a diverse array of systems. We have developed, based on the Java Commodity Grid Kit (CoG Kit), a sophisticated and extensible workflow system that seamlessly integrates with the queueing system Cobalt through the advanced features provided by the CoG Kit.
The LDAP Browser/Editor provides a user-friendly Java-based interface to LDAP databases with tigh... more The LDAP Browser/Editor provides a user-friendly Java-based interface to LDAP databases with tightly integrated browsing and editing capabilities. Entirely written in Java with help of the JFC (Swingset) and JNDI class libraries. It connects to any X.500, LDAP v2 and v3 servers and supports editing of multiple-value attributes.
Hardware virtualization has been gaining a significant share of computing time in the last years.... more Hardware virtualization has been gaining a significant share of computing time in the last years. Using virtual machines (VMs) for parallel computing is an attractive option for many users. A VM gives users a freedom of choosing an operating system, software stack and security policies, leaving the physical hardware, OS management, and billing to physical cluster administrators. The well-known solutions for cloud computing, both commercial (Amazon Cloud, Google Cloud, Yahoo Cloud, etc.) and open-source (OpenStack, Eucalyptus) provide platforms for running a single VM or a group of VMs. With all the benefits, there are also some drawbacks, which include reduced performance when running code inside of a VM, increased complexity of cluster management, as well as the need to learn new tools and protocols to manage the clusters. At SDSC, we have created a novel framework and infrastructure by providing virtual HPC clusters to projects using the NSF sponsored Comet supercomputer. Managing virtual clusters on Comet is similar to managing a baremetal cluster in terms of processes and tools that are employed. This is beneficial because such processes and tools are familiar to cluster administrators. Unlike platforms like AWS, Comet's virtualization capability supports installing VMs from ISOs (i.e., a CD-ROM or DVD image) or via an isolated management VLAN (PXE). At the same time, we're helping projects take advantage of VMs by providing an enhanced client tool for interaction with our management system called Cloudmesh client. Cloudmesh client can also be used to manage virtual machines on OpenStack, AWS, and Azure. The article describes our design and approach to running virtual clusters, the tools we developed, and initial user experience.
Concurrency and Computation: Practice and Experience, 2007
We introduce a framework for measuring the use of Grid services and exposing simple summary data ... more We introduce a framework for measuring the use of Grid services and exposing simple summary data to an authorized set of Grid users through a JSR168-enabled portal[7, 1]. The sensor framework has been integrated into the Globus Toolkit and allows Grid administrators to have access to a mechanism helping with report and usage statistics. Although the original focus was the reporting of actions in relationship to GridFTP services, the usage service has been expanded to report also on use of other Grid services.
Cloud computing is emerging as the prominent new paradigm used in distributed systems today. One ... more Cloud computing is emerging as the prominent new paradigm used in distributed systems today. One of the features that makes Clouds attractive is their ability to provide advanced services to users cost-effectively by taking advantage of the economies of scale. In this, large scale Cloud data centers have recently seen widespread deployment within both academia and industry. However, as the demand for such computational resources increases with the costs of using limited energy resources, there is a need to increase energy efficiency throughout the entire Cloud. This manuscript presents a comprehensive system-level framework for identifying ways to integrate novel green computing concepts into tomorrow's Cloud systems. This framework includes components for advanced scheduling algorithms, virtual machine management, efficient virtual machine image design, service level agreements, and sophisticated data center designs. While the research activities discussed in each component improve overall system efficiency with little or no performance impact on an individual level, it's the green framework which provides the foundation for such research to build upon and have a lasting impact on the way in which data centers operate in the future.
Future Generation Computer Systems, Jul 1, 2023
In this paper, we describe a service oriented architecture and Grid abstraction framework that al... more In this paper, we describe a service oriented architecture and Grid abstraction framework that allows us to access Grids through JavaScript. Obviously, such a framework integrates well with other Web 2.0 technologies. The framework consists of two parts. A client Application Programming Interface (API) to access the Grid via JavaScript and a mediator service and API through which the Grid access is channeled. The framework uses commodity Web service standards and provides extended functionality such as ...
arXiv (Cornell University), Oct 30, 2022
In this paper, we summarize our effort to create and utilize a simple framework to coordinate com... more In this paper, we summarize our effort to create and utilize a simple framework to coordinate computational analytics tasks with the help of a workflow system. Our design is based on a minimalistic approach while at the same time allowing to access computational resources offered through the owner's computer, HPC computing centers, cloud resources, and distributed systems in general. The access to this framework includes a simple GUI for monitoring and managing the workflow, a REST service, a command line interface, as well as a Python interface. The resulting framework was developed for several examples targeting benchmarks of AI applications on hybrid compute resources and as an educational tool for teaching scientists and students sophisticated concepts to execute computations on resources ranging from a single computer to many thousands of computers as part of on-premise and cloud infrastructure. We demonstrate the usefulness of the tool on a number of examples. The code is available as an open-source project in GitHub and is based on an easy-to-enhance tool called cloudmesh. CCS Concepts: • Computer systems organization → Distributed architectures; Cloud computing; • Software and its engineering → Distributed systems organizing principles.
arXiv (Cornell University), Oct 8, 2020
The COVID-19 pandemic has profound global consequences on health, economic, social, political, an... more The COVID-19 pandemic has profound global consequences on health, economic, social, political, and almost every major aspect of human life. Therefore, it is of great importance to model COVID-19 and other pandemics in terms of the broader social contexts in which they take place. We present the architecture of AICov, which provides an integrative deep learning framework for COVID-19 forecasting with population covariates, some of which may serve as putative risk factors. We have integrated multiple different strategies into AICov, including the ability to use deep learning strategies based on LSTM and even modeling. To demonstrate our approach, we have conducted a pilot that integrates population covariates from multiple sources. Thus, AICov not only includes data on COVID-19 cases and deaths but, more importantly, the population's socioeconomic, health and behavioral risk factors at a local level. The compiled data are fed into AICov, and thus we obtain improved prediction by integration of the data to our model as compared to one that only uses case and death data.
Common finctions to simplify the immplementation of a command shell such as CMD5 in python
Practice and Experience in Advanced Research Computing, Jul 17, 2021
The United States science and engineering community faces multiple challenges related to funding ... more The United States science and engineering community faces multiple challenges related to funding and funding policies for science and engineering. A framework is needed to evaluate the impact of scientific facilities and instruments. In this paper, we demonstrate such an activity through our comprehensive work evaluating the scientific impact of XSEDE using the Semantic Scholar Data. In contrast to other studies, our study includes the bibliographic references of all recorded papers related to XSEDE over the entire performance period till March of 2021. This makes this study unique and distinguishes it from our earlier work while using (a) over 180 million papers as a comparison to our peer analysis, (b) include all publications reported, and (c) conduct the study repeatedly over several years.
We present a framework that compares the publication impact based on a comprehensive peer analysi... more We present a framework that compares the publication impact based on a comprehensive peer analysis of papers produced by scientists using XSEDE and NCAR resources. The analysis is introducing a percentile ranking based approach of citations of the XSEDE and NCAR papers compared to peer publications in the same journal that do not use these resources. This analysis is unique in that it evaluates the impact of the two facilities by comparing the reported publications from them to their peers from within the same journal issue. From this analysis, we can see that papers that utilize XSEDE and NCAR resources are cited statistically significantly more often. Hence we find that reported publications indicate that XSEDE and NCAR resources exert a strong positive impact on scientific research.
Concurrency and Computation: Practice and Experience, Apr 17, 2011
Electronic Health Records (EHRs) have many potential advantages over traditional paper records, s... more Electronic Health Records (EHRs) have many potential advantages over traditional paper records, such as wide scale access, error checking, and protection from physical damage to a record. As with any medical record, paper or electronic, both the patient's privacy and the document's integrity must be guaranteed. With initiatives such as Integrating the Healthcare Enterprise (IHE), computerized healthcare systems are able to share EHRs on a large scale, while protecting the patient's privacy rights. However, IHE does not yet meet the needs for all healthcare systems, as we will show with the eMOLST project. The eMOLST project delivers software in support of Medical Order for Life Sustaining Treatment (MOLST) forms and uses IHE specifications for cross enterprise document storage and sharing, patient identification, and user authentication & authorization. The Web based system provides secure access to electronic MOLST documents regardless of the patient's or healthcare provider's location. The eMOLST project allows a user to have Single Sign On (SSO) access to the system from either the user's associated enterprise, or through a Web portal shared amongst all users across all enterprises. In this paper, we show a security solution to allow SSO from multiple access points for IHE compliant systems.
We present the design of a toolkit that can be employed by users and administrators to manage vir... more We present the design of a toolkit that can be employed by users and administrators to manage virtual machines on multi-cloud environments. It can be run by individual users or offered as a service to a shared user community. We have practically demonstrated its use as part of a Future-Grid service, allowing users of FutureGrid to utilize such a service. Furthermore, we discuss implications and solutions for a unified metrics system assisting the users to find and utilize resources appropriate for their applications. Lastly, we discuss how to move such a multi-cloud environment forward by integrating clouds managed by the community or are offered as public clouds. This includes the introduction of a mutual trust agreement on a user and project basis. We have developed a number of components that support the creation of such a multi-cloud environment. This system is known as Cloudmesh and has been used in practice to achieve virtual machine management in multiple clouds. An important distinguishing factor of Cloudmesh is that it also allows the use of bare metal provisioning for supporting service providers and authorized users, offering services beyond those available by typical clouds.
In recent years the power of Grid computing has grown exponentially through the development of ad... more In recent years the power of Grid computing has grown exponentially through the development of advanced middleware systems. While usage has increased, the penetration of Grid computing in the scientific community has been less than expected by some. This is due to a steep learning curve and high entry barrier that limit the use of Grid computing and advanced cyberinfrastructure. In order for the scientists to focus on actual scientific tasks, specialized tools and services need to be developed to ease the integration of complex middleware. Our solution is Cyberaide Shell, an advanced but simple to use system shell which provides access to the powerful cyberinfrastructure available today. Cyberaide Shell provides a dynamic interface that allows access to complex cyberinfrastructure in an easy and intuitive fashion on an ad-hoc basis. This is accomplished by abstracting the complexities of resource, task, and application management through a scriptable command line interface. Through a service integration mechanism, the shell's functionality is exposed to a wide variety of frameworks and programming languages. Cyberaide Shell includes specialized experiment management and workflow commands that, with the scriptable nature of a shell, provide a set of services which where previously unavailable. The usability of Cyberaide Shell is demonstrated using a Water Threat Management application deployed on the TeraGrid.
Cloud computing has become an important driver for delivering infrastructure as a service (IaaS) ... more Cloud computing has become an important driver for delivering infrastructure as a service (IaaS) to users with on-demand requests for customized environments and sophisticated software stacks. Within the FutureGrid (FG) project, we offer different IaaS frameworks as well as high performance computing infrastructures by allowing users to explore them as part of the FG testbed. To ease the use of these infrastructures, as part of performance experiments, we have designed an image management framework, which allows us to create user defined software stacks based on abstract image management and uniform image registration. Consequently, users can create their own customized environments very easily. The complex processes of the underlying infrastructures are managed by our sophisticated software tools and services. Besides being able to manage images for IaaS frameworks, we also allow the registration and deployment of images onto bare-metal by the user. This level of functionality is typically not offered in a HPC (high performance computing) infrastructure. However, our approach provides users with the ability to create their own environments changing the paradigm of administrator-controlled dynamic provisioning to user-controlled dynamic provisioning, which we also call raining. Thus, users obtain access to a testbed with the ability to manage state-of-the-art software stacks that would otherwise not be supported in typical compute centers. Security is also considered by vetting images before they are registered in a infrastructure. In this paper, we present the design of our image management framework and evaluate two of its major components. This includes the image creation and image registration. Our design and implementation can support the current FG user community interested in such capabilities.
Abstract—FutureGrid (FG) is an experimental, highperformance testbed that support HPC, cloud and ... more Abstract—FutureGrid (FG) is an experimental, highperformance testbed that support HPC, cloud and grid computing experiments for both applications and computer science. FutureGrid will employ virtualization technology to allow the testbed to support a wide range of operating systems. Therefore, the efficient management of virtual machine images (from now on called images) becomes a key issue. Current cloud frameworks do not provide a way to manage images for different frameworks. That is, they have their own image ...
Civil-comp proceedings, Mar 16, 2011
We present a workflow-based algorithm for identifying threads to an urban water management system... more We present a workflow-based algorithm for identifying threads to an urban water management system. Through Grid computing we provide the necessary high-performance computing resources to deliver quickly solutions to the problem. We prototyped a new middleware called cyberaide, that enables easy access to Grid resources through portals or the command line. A workflow system is used to manage resources in fault tolerant fashion. In addition, we contrast the architecture with a Hadoop implementation. Resources from TeraGrid and FutureGrid are used to test the feasibility of using the toolkit for a scientific application.
Workflow management is an important part of scientific experiments. A common pattern that scienti... more Workflow management is an important part of scientific experiments. A common pattern that scientists are using is based on repetitive job execution on a variety of different systems, and managing such job execution is necessary for large-scale scientific workflows. The workflow system should also be client-based and able to handle multiple security contexts to allow researchers to take advantage of a diverse array of systems. We have developed, based on the Java Commodity Grid Kit (CoG Kit), a sophisticated and extensible workflow system that seamlessly integrates with the queueing system Cobalt through the advanced features provided by the CoG Kit.
The LDAP Browser/Editor provides a user-friendly Java-based interface to LDAP databases with tigh... more The LDAP Browser/Editor provides a user-friendly Java-based interface to LDAP databases with tightly integrated browsing and editing capabilities. Entirely written in Java with help of the JFC (Swingset) and JNDI class libraries. It connects to any X.500, LDAP v2 and v3 servers and supports editing of multiple-value attributes.
Hardware virtualization has been gaining a significant share of computing time in the last years.... more Hardware virtualization has been gaining a significant share of computing time in the last years. Using virtual machines (VMs) for parallel computing is an attractive option for many users. A VM gives users a freedom of choosing an operating system, software stack and security policies, leaving the physical hardware, OS management, and billing to physical cluster administrators. The well-known solutions for cloud computing, both commercial (Amazon Cloud, Google Cloud, Yahoo Cloud, etc.) and open-source (OpenStack, Eucalyptus) provide platforms for running a single VM or a group of VMs. With all the benefits, there are also some drawbacks, which include reduced performance when running code inside of a VM, increased complexity of cluster management, as well as the need to learn new tools and protocols to manage the clusters. At SDSC, we have created a novel framework and infrastructure by providing virtual HPC clusters to projects using the NSF sponsored Comet supercomputer. Managing virtual clusters on Comet is similar to managing a baremetal cluster in terms of processes and tools that are employed. This is beneficial because such processes and tools are familiar to cluster administrators. Unlike platforms like AWS, Comet's virtualization capability supports installing VMs from ISOs (i.e., a CD-ROM or DVD image) or via an isolated management VLAN (PXE). At the same time, we're helping projects take advantage of VMs by providing an enhanced client tool for interaction with our management system called Cloudmesh client. Cloudmesh client can also be used to manage virtual machines on OpenStack, AWS, and Azure. The article describes our design and approach to running virtual clusters, the tools we developed, and initial user experience.
Concurrency and Computation: Practice and Experience, 2007
We introduce a framework for measuring the use of Grid services and exposing simple summary data ... more We introduce a framework for measuring the use of Grid services and exposing simple summary data to an authorized set of Grid users through a JSR168-enabled portal[7, 1]. The sensor framework has been integrated into the Globus Toolkit and allows Grid administrators to have access to a mechanism helping with report and usage statistics. Although the original focus was the reporting of actions in relationship to GridFTP services, the usage service has been expanded to report also on use of other Grid services.
Cloud computing is emerging as the prominent new paradigm used in distributed systems today. One ... more Cloud computing is emerging as the prominent new paradigm used in distributed systems today. One of the features that makes Clouds attractive is their ability to provide advanced services to users cost-effectively by taking advantage of the economies of scale. In this, large scale Cloud data centers have recently seen widespread deployment within both academia and industry. However, as the demand for such computational resources increases with the costs of using limited energy resources, there is a need to increase energy efficiency throughout the entire Cloud. This manuscript presents a comprehensive system-level framework for identifying ways to integrate novel green computing concepts into tomorrow's Cloud systems. This framework includes components for advanced scheduling algorithms, virtual machine management, efficient virtual machine image design, service level agreements, and sophisticated data center designs. While the research activities discussed in each component improve overall system efficiency with little or no performance impact on an individual level, it's the green framework which provides the foundation for such research to build upon and have a lasting impact on the way in which data centers operate in the future.