10th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing

Research Article

Exploring HPC-based Scientific Software as a Service using CometCloud

Download674 downloads
  • @INPROCEEDINGS{10.4108/icst.collaboratecom.2014.257833,
        author={Moustafa AbdelBaky and Javier Diaz-Montes and Michael Johnston and Vipin Sachdeva and Richard L. Anderson and Kirk E. Jordan and Manish Parashar},
        title={Exploring HPC-based Scientific Software as a Service using CometCloud},
        proceedings={10th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing},
        publisher={IEEE},
        proceedings_a={COLLABORATECOM},
        year={2014},
        month={11},
        keywords={software as a service science as a service scientific computing; dissipative particle dymanics},
        doi={10.4108/icst.collaboratecom.2014.257833}
    }
    
  • Moustafa AbdelBaky
    Javier Diaz-Montes
    Michael Johnston
    Vipin Sachdeva
    Richard L. Anderson
    Kirk E. Jordan
    Manish Parashar
    Year: 2014
    Exploring HPC-based Scientific Software as a Service using CometCloud
    COLLABORATECOM
    IEEE
    DOI: 10.4108/icst.collaboratecom.2014.257833
Moustafa AbdelBaky1,*, Javier Diaz-Montes1, Michael Johnston2, Vipin Sachdeva2, Richard L. Anderson3, Kirk E. Jordan2, Manish Parashar1
  • 1: Rutgers Discovery Informatics Institute
  • 2: IBM TJ Watson Research Center
  • 3: Science and Technology Facilities Council
*Contact email: moustafa.a@rutgers.edu

Abstract

The use of in-silico simulations in experimental science can greatly increase laboratory efficiency and provide additional insights into interactions not easily described by traditional methods. Such simulations require significant amounts of computational resources, accessible only via supercomputers of large-scale high-performance clusters. Due to the complexity of the computational experiments, as well as the usage of the underlying resources, experimental scientists heavily rely on computational scientists with HPC expertise to perform these simulations. This additional bottleneck prevents the widespread adoption of real time in-silico simulation as a driver for laboratory experimentation. In this paper, we aim to overcome this bottleneck by presenting the architecture of an end-to-end framework to enable HPC Software as a Service. This framework is designed to make it easy for scientific applications to run on top of dynamically federated HPC resources. The framework enables HPC resource sharing while maximizing throughput and utilization. We focus specifically on a use case where an experimental scientist uses a mobile portal to control dissipative particle dynamics experiments that are executed on a remote supercomputer (IBM Blue Gene/Q).