A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation

Simon Malkowski; Markus Hedwig; Deepal Jayasinghe; Junhee Park; Yasuhiko Kanemasa; Calton Pu

5th International ICST Conference on Collaborative Computing: Networking, Applications, Worksharing

Research Article

A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation

Download563 downloads

Cite: BibTeX Plain Text

@INPROCEEDINGS{10.4108/ICST.COLLABORATECOM2009.8311 ,
    author={Simon Malkowski and Markus Hedwig and Deepal Jayasinghe and Junhee Park and Yasuhiko Kanemasa and Calton Pu},
    title={A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation},
    proceedings={5th International ICST Conference on Collaborative Computing: Networking, Applications, Worksharing},
    proceedings_a={COLLABORATECOM},
    year={2009},
    month={12},
    keywords={Database systems Hardware Information analysis Information systems Laboratories Paper technology Pattern analysis Performance analysis Relational databases Scalability},
    doi={10.4108/ICST.COLLABORATECOM2009.8311 }
}

Simon Malkowski
Markus Hedwig
Deepal Jayasinghe
Junhee Park
Yasuhiko Kanemasa
Calton Pu
Year: 2009
A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation
COLLABORATECOM
ICST
DOI: 10.4108/ICST.COLLABORATECOM2009.8311

Simon Malkowski¹^,*, Markus Hedwig²^,*, Deepal Jayasinghe¹^,*, Junhee Park¹^,*, Yasuhiko Kanemasa³^,*, Calton Pu¹^,*

1: CERCS, Georgia Institute of Technology, Atlanta, GA 30332-0765, USA
2: Chair of Information Systems Research, University of Freiburg, 79098 Freiburg, Germany
3: Fujitsu Laboratories Ltd., Kawasaki 211-8588, Japan

*Contact email: simon.malkowski@cc.gatech.edu, markus.hedwig@is.uni-freiburg.de, deepal@cc.gatech.edu, jhpark@cc.gatech.edu, kanemasa@jp.fujitsu.com, calton@cc.gatech.edu

Abstract

Economical configuration planning, component performance evaluation, and analysis of bottleneck phenomena in N-tier applications are serious challenges due to design requirements such as non-stationary workloads, complex non-modular relationships, and global consistency management when replicating database servers, for instance. We have conducted an extensive experimental evaluation of N-tier applications, which adopts a purely empirical approach the aforementioned challenges, using the RUBBoS benchmark. As part of the analysis of our exceptionally rich dataset, we have experimentally investigated database server scalability, bottleneck phenomena identification, and iterative data refinement for configuration planning. The experiments detailed in this paper are comprised of a full scale-out mesh with up to nine database servers and three application servers. Additionally, the four-tier system was run in a variety of configurations, including two database management systems (MySQL and PostgreSQL), two hardware node types (normal and low-cost), two replication strategies (wait-all and wait-first - which approximates primary/secondary), and two database replication techniques (C-JDBC and MySQL Cluster). Herein, we present an analysis survey of results mainly generated with a read/write mix pattern in the client emulator.

Keywords: Database systems Hardware Information analysis Information systems Laboratories Paper technology Pattern analysis Performance analysis Relational databases Scalability

Published: 2009-12-28

: http://dx.doi.org/10.4108/ICST.COLLABORATECOM2009.8311