Collaborative Computing: Networking, Applications and Worksharing. 13th International Conference, CollaborateCom 2017, Edinburgh, UK, December 11–13, 2017, Proceedings

Research Article

On Cost Efficient Dataflow Computing Program Deployment in SDN Managed Distributed Computing Environment

Download
92 downloads
  • @INPROCEEDINGS{10.1007/978-3-030-00916-8_3,
        author={Yating Zhang and Yuepeng Li and Long Zheng and Deze Zeng},
        title={On Cost Efficient Dataflow Computing Program Deployment in SDN Managed Distributed Computing Environment},
        proceedings={Collaborative Computing: Networking, Applications and Worksharing. 13th International Conference, CollaborateCom 2017, Edinburgh, UK, December 11--13, 2017, Proceedings},
        proceedings_a={COLLABORATECOM},
        year={2018},
        month={10},
        keywords={},
        doi={10.1007/978-3-030-00916-8_3}
    }
    
  • Yating Zhang
    Yuepeng Li
    Long Zheng
    Deze Zeng
    Year: 2018
    On Cost Efficient Dataflow Computing Program Deployment in SDN Managed Distributed Computing Environment
    COLLABORATECOM
    Springer
    DOI: 10.1007/978-3-030-00916-8_3
Yating Zhang1, Yuepeng Li2, Long Zheng3,*, Deze Zeng2
  • 1: Shanghai Jiao Tong University
  • 2: China University of Geosciences
  • 3: Shenzhen University
*Contact email: lzheng.aizu@gmail.com

Abstract

Dataflow computing has been regarded one of the most promising computing paradigms in the big data era. With the vast distribution of data sources, it is significant to deploy the dataflow based applications in distributed environment to digest these data. In dataflow computing, the data flows shall be transferred between different processing units to the accomplish the predefined semantics. Software-defined networking (SDN) has emerged as an effective network management technology to orchestrate the data flows among these processing units. For each data flow, a forwarding rule shall be inserted into the forwarding table of each switch on the routing path. However, the number of rules that can be inserted in one forwarding table is limited. We are motivated to take such constraints into the consideration of dataflow applications deployment in distributed computing environment managed by SDN. An efficient deployment algrotithm is proposed and evaluated in this paper.