Networks for Grid Applications. Third International ICST Conference, GridNets 2009, Athens, Greece, September 8-9, 2009, Revised Selected Papers

Research Article

The Open Cloud Testbed: Supporting Open Source Cloud Computing Systems Based on Large Scale High Performance, Dynamic Network Services

Download
655 downloads
  • @INPROCEEDINGS{10.1007/978-3-642-11733-6_10,
        author={Robert Grossman and Yunhong Gu and Michal Sabala and Colin Bennet and Jonathan Seidman and Joe Mambratti},
        title={The Open Cloud Testbed: Supporting Open Source Cloud Computing Systems Based on Large Scale High Performance, Dynamic Network Services},
        proceedings={Networks for Grid Applications. Third International ICST Conference, GridNets 2009, Athens, Greece, September 8-9, 2009, Revised Selected Papers},
        proceedings_a={GRIDNETS},
        year={2012},
        month={6},
        keywords={},
        doi={10.1007/978-3-642-11733-6_10}
    }
    
  • Robert Grossman
    Yunhong Gu
    Michal Sabala
    Colin Bennet
    Jonathan Seidman
    Joe Mambratti
    Year: 2012
    The Open Cloud Testbed: Supporting Open Source Cloud Computing Systems Based on Large Scale High Performance, Dynamic Network Services
    GRIDNETS
    Springer
    DOI: 10.1007/978-3-642-11733-6_10
Robert Grossman, Yunhong Gu1, Michal Sabala1, Colin Bennet2, Jonathan Seidman2, Joe Mambratti3
  • 1: University of Illinois at Chicago
  • 2: Open Data Group
  • 3: Northwestern University

Abstract

Recently, a number of cloud platforms and services have been developed for data intensive computing, including Hadoop, Sector, CloudStore (formerly KFS), HBase, and Thrift. In order to benchmark the performance of these systems, to investigate their interoperability, and to experiment with new services based on flexible compute node and network provisioning capabilities, we have designed and implemented a large scale testbed called the Open Cloud Testbed (OCT). Currently OCT has 120 nodes in 4 data centers: Baltimore, Chicago (two locations), and San Diego. In contrast to other cloud testbeds, which are in small geographic areas and which are based on commodity Internet services, the OCT is a wide area testbed and the 4 data centers are connected with a high performance 10Gb/s network, based on a foundation of dedicated lightpaths. This testbed can address the requirements of extremely large data streams that challenge other types of distributed infrastructure. We have also developed several utilities to support the development of cloud computing systems and services, including novel node and network provisioning services, a monitoring system, and an RPC system. In this paper, we describe the OCT concepts, architecture, infrastructure, a few benchmarks that were developed for this platform, interoperability studies, and results.