3rd International ICST Conference on COMmunication System SoftWAre and MiddlewaRE

Research Article

An Efficient and Bandwidth Sensitive Parallel Download Scheme in Data Grids

  • @INPROCEEDINGS{10.1109/COMSWA.2008.4554429,
        author={Ruay-Shiung Chang and Chun-Fu Lin and Jiing-Hsing Ruey and Shih-Chun Hsi},
        title={An Efficient and Bandwidth Sensitive Parallel Download Scheme in Data Grids},
        proceedings={3rd International ICST Conference on COMmunication System SoftWAre and MiddlewaRE},
        publisher={IEEE},
        proceedings_a={COMSWARE},
        year={2008},
        month={6},
        keywords={},
        doi={10.1109/COMSWA.2008.4554429}
    }
    
  • Ruay-Shiung Chang
    Chun-Fu Lin
    Jiing-Hsing Ruey
    Shih-Chun Hsi
    Year: 2008
    An Efficient and Bandwidth Sensitive Parallel Download Scheme in Data Grids
    COMSWARE
    IEEE
    DOI: 10.1109/COMSWA.2008.4554429
Ruay-Shiung Chang1,*, Chun-Fu Lin1,*, Jiing-Hsing Ruey1,*, Shih-Chun Hsi1
  • 1: Department of Computer Science and Information Engineering, National Dong Hwa University, Hualien, TAIWAN, R.O.C
*Contact email: rschang@mail.ndhu.edu.tw, d9621009@em96.ndhu.edu.tw, d9421001@em94.ndhu.edu.tw

Abstract

For modern scientific applications such as astrophysics, astronomy, aerography, and biology, a large amount of storage space is required because of the large-scale datasets. Data Grid collects distributed storage resources such as hard disk space across heterogeneous networks to meet such requirements. In data grid environment, data replication service that copies the replicas to proper storage systems increases the reliability of the data access. By means of these replicas, parallel download creates multiple connections from the client side to the replica servers to improve the performance of the data transfer. To adapt the bandwidth-variation and to make the data transferring more efficient, a parallel download scheme which is called EA (Efficient and Adaptive) parallel download is proposed in this paper. The scheme is to re-evaluate all of the replica servers during the download progress and replace the decaying selected servers with better backup servers. According to our experiments in the Unigrid environment, the EA parallel download decreases the completion time by 1.63% to 13.45% in natural Unigrid environment and 6.28% to 30.56% in choreographed Unigrid environment when compared to the Recursive Co-Allocation scheme. It means that the proposed scheme adapts to the dynamic environment nicely and decreases the total download time effectively.