Testbeds and Research Infrastructure. Development of Networks and Communities. 7th International ICST Conference,TridentCom 2011, Shanghai, China, April 17-19, 2011, Revised Selected Papers

Research Article

A Portal to Support Rigorous Experimental Methodology in Networking Research

Download
394 downloads
  • @INPROCEEDINGS{10.1007/978-3-642-29273-6_18,
        author={Guillaume Jourjon and Thierry Rakotoarivelo and Max Ott},
        title={A Portal to Support Rigorous Experimental Methodology in Networking Research},
        proceedings={Testbeds and Research Infrastructure. Development of Networks and Communities. 7th International ICST Conference,TridentCom 2011, Shanghai, China, April 17-19, 2011, Revised Selected Papers},
        proceedings_a={TRIDENTCOM},
        year={2012},
        month={5},
        keywords={scientific method data quality measurement testbeds OMF},
        doi={10.1007/978-3-642-29273-6_18}
    }
    
  • Guillaume Jourjon
    Thierry Rakotoarivelo
    Max Ott
    Year: 2012
    A Portal to Support Rigorous Experimental Methodology in Networking Research
    TRIDENTCOM
    Springer
    DOI: 10.1007/978-3-642-29273-6_18
Guillaume Jourjon1,*, Thierry Rakotoarivelo1,*, Max Ott1,*
  • 1: NICTA
*Contact email: Guillaume.Jourjon@nicta.com.au, Thierry.Rakotoarivelo@nicta.com.au, Max.Ott@nicta.com.au

Abstract

Whilst dealing with topics that are more and more influenced by physical properties of the underlying media, the networking community still lacks a culture of rigorous result verification. Indeed, as opposed to most of the science and engineering fields there are very few benchmarks to test protocols against. Furthermore, in most publications the authors do not give the community access to the raw results or details of the performed experimental procedures. Therefore it is impossible to accurately reproduce their experiments. We propose to solve this problem by extending the state of the art experiment tool OMF with a public portal. This portal, while providing the experimenter with access to experimental resources, also provides the community with a system for comprehensive experiment description and result verification. The collection of both the measurement set and the experiment’s description is done in a transparent manner for the experimenter, who can decide to publish them via the portal once the research is mature enough.