Research Article
Cost-Aware Big Data Stream Processing in Cloud Environment
@INPROCEEDINGS{10.1007/978-3-030-69992-5_10, author={Ahmed Al-Mansoori and Jemal Abawajy and Morshed Chowdhury}, title={Cost-Aware Big Data Stream Processing in Cloud Environment}, proceedings={Cloud Computing. 10th EAI International Conference, CloudComp 2020, Qufu, China, December 11-12, 2020, Proceedings}, proceedings_a={CLOUDCOMP}, year={2021}, month={2}, keywords={Big data stream processing Cloud computing SSP Cost-aware}, doi={10.1007/978-3-030-69992-5_10} }- Ahmed Al-Mansoori
Jemal Abawajy
Morshed Chowdhury
Year: 2021
Cost-Aware Big Data Stream Processing in Cloud Environment
CLOUDCOMP
Springer
DOI: 10.1007/978-3-030-69992-5_10
Abstract
The increasing size of big data and the speed with which it is generated have put a tremendous burden on cloud storage and communication systems. Network traffic and server capacity are crucial to having systems that are cost aware during big data stream processing in Software-Defined Network (SDN) enabled cloud environment. The common approach to address this problem has been through various optimization techniques. In this paper, we propose SDN based cost optimization approach to address the problem. Although SDN has been shown to improve cloud system performance, there is little attention given to SDN-based cost optimization approach to address the challenges of the increasing big data. To this end, we used Spark Streaming Processing approach (SSP). The proposed cost optimization approach is based on SDN within the cloud environment and focuses on optimizing the communication and computational costs. We performed extensive experiments to valid the approach and compared it with a Spark Streaming approach. The results of the experiment show that the proposed approach has better cost optimization than the baseline approach.
