7th International Conference on Collaborative Computing: Networking, Applications and Worksharing

Research Article

CONFLuEnCE: Implementation and Application Design

Download606 downloads
  • @INPROCEEDINGS{10.4108/icst.collaboratecom.2011.247204,
        author={Panayiotis Neophytou and Panos Chrysanthis and Alexandros Labrinidis},
        title={CONFLuEnCE: Implementation and Application Design},
        proceedings={7th International Conference on Collaborative Computing: Networking, Applications and Worksharing},
        keywords={workflow continuous workflows data streams monitoring applications},
  • Panayiotis Neophytou
    Panos Chrysanthis
    Alexandros Labrinidis
    Year: 2012
    CONFLuEnCE: Implementation and Application Design
    DOI: 10.4108/icst.collaboratecom.2011.247204
Panayiotis Neophytou1,*, Panos Chrysanthis1, Alexandros Labrinidis1
  • 1: University of Pittsburgh
*Contact email: panickos@cs.pitt.edu


Data streams have become pervasive and data production rates are increasing exponentially, driven by advances in technology, for example the proliferation of sensors, smart phones, and their applications. This fact effectuates an unprecedented opportunity to build real-time monitoring and analytics applications, which when used collaboratively and interactively, will provide insights to every aspect of our environment, both in the business and scientific domains.

In our previous work, we have identified the need for workflow management systems which are capable of orchestrating the processing of multiple heterogeneous data streams, while enabling their users to interact collaboratively with the workflows in real time. In this paper, we describe CONFLuEnCE (CONtinuous workFLow ExeCution Engine), which is an implementation of our continuous workflow model. CONFLuEnCE is built on top of Kepler, an existing workflow management system, by fusing stream semantics and stream processing methods as another computational domain. Furthermore, we explicate our experiences in designing and implementing real-life business and scientific continuous workflow monitoring applications, which attest to the ease of use and applicability of our system.