5th International ICST Conference on Collaborative Computing: Networking, Applications, Worksharing

Research Article

A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation

Download81 downloads
  • @INPROCEEDINGS{10.4108/ICST.COLLABORATECOM2009.8311 ,
        author={Simon Malkowski and Markus Hedwig and Deepal Jayasinghe and Junhee Park and Yasuhiko Kanemasa and Calton Pu},
        title={A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation},
        proceedings={5th International ICST Conference on Collaborative Computing: Networking, Applications, Worksharing},
        proceedings_a={COLLABORATECOM},
        year={2009},
        month={12},
        keywords={Database systems Hardware Information analysis Information systems Laboratories Paper technology Pattern analysis Performance analysis Relational databases Scalability},
        doi={10.4108/ICST.COLLABORATECOM2009.8311 }
    }
    
  • Simon Malkowski
    Markus Hedwig
    Deepal Jayasinghe
    Junhee Park
    Yasuhiko Kanemasa
    Calton Pu
    Year: 2009
    A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation
    COLLABORATECOM
    ICST
    DOI: 10.4108/ICST.COLLABORATECOM2009.8311
Simon Malkowski1,*, Markus Hedwig2,*, Deepal Jayasinghe1,*, Junhee Park1,*, Yasuhiko Kanemasa3,*, Calton Pu1,*
  • 1: CERCS, Georgia Institute of Technology, Atlanta, GA 30332-0765, USA
  • 2: Chair of Information Systems Research, University of Freiburg, 79098 Freiburg, Germany
  • 3: Fujitsu Laboratories Ltd., Kawasaki 211-8588, Japan
*Contact email: simon.malkowski@cc.gatech.edu, markus.hedwig@is.uni-freiburg.de, deepal@cc.gatech.edu, jhpark@cc.gatech.edu, kanemasa@jp.fujitsu.com, calton@cc.gatech.edu

Abstract

Economical configuration planning, component performance evaluation, and analysis of bottleneck phenomena in N-tier applications are serious challenges due to design requirements such as non-stationary workloads, complex non-modular relationships, and global consistency management when replicating database servers, for instance. We have conducted an extensive experimental evaluation of N-tier applications, which adopts a purely empirical approach the aforementioned challenges, using the RUBBoS benchmark. As part of the analysis of our exceptionally rich dataset, we have experimentally investigated database server scalability, bottleneck phenomena identification, and iterative data refinement for configuration planning. The experiments detailed in this paper are comprised of a full scale-out mesh with up to nine database servers and three application servers. Additionally, the four-tier system was run in a variety of configurations, including two database management systems (MySQL and PostgreSQL), two hardware node types (normal and low-cost), two replication strategies (wait-all and wait-first - which approximates primary/secondary), and two database replication techniques (C-JDBC and MySQL Cluster). Herein, we present an analysis survey of results mainly generated with a read/write mix pattern in the client emulator.