Signal Processing and Information Technology. First International Joint Conference, SPIT 2011 and IPC 2011, Amsterdam, The Netherlands, December 1-2, 2011, Revised Selected Papers

Research Article

High Speed Data Loading for Large Sized RDBMS Tables

Download
467 downloads
  • @INPROCEEDINGS{10.1007/978-3-642-32573-1_48,
        author={Prabin Sahoo and Chetan Phalak},
        title={High Speed Data Loading for Large Sized RDBMS Tables},
        proceedings={Signal Processing and Information Technology. First International Joint Conference, SPIT 2011 and IPC 2011, Amsterdam, The Netherlands, December 1-2, 2011, Revised Selected Papers},
        proceedings_a={SPIT \& IPC},
        year={2012},
        month={10},
        keywords={RDBMS Loader Partitions Parallelism Queries Performance sqlldr},
        doi={10.1007/978-3-642-32573-1_48}
    }
    
  • Prabin Sahoo
    Chetan Phalak
    Year: 2012
    High Speed Data Loading for Large Sized RDBMS Tables
    SPIT & IPC
    Springer
    DOI: 10.1007/978-3-642-32573-1_48
Prabin Sahoo1,*, Chetan Phalak1,*
  • 1: Tata Consultancy Services
*Contact email: prabin.sahoo@tcs.com, chetan1.phalak@tcs.com

Abstract

Data loading into RDBMS is a common phenomenon over decades. Over the years RDBMS has dominated in the enterprise world. Conventional file systems are seen to be replaced with popular RDBMS such as Oracle ®, UDB ®, and Sybase ® etc. This has necessitated the need for data loading while migrating from file systems to RDBMS. In some cases data loading is an everyday activity, for example, dataware housing projects involving data gathering, mining and analysis. No matter what type of data loading it may be, the goal is common i.e. how to achieve high speed in data loading for large sized table to minimize the down time. In this paper we are demonstrating how we can achieve high speed data loading into large RDBMS tables.