Workshop Experience Design and Evaluation of Social UCM applications

Research Article

User-Centric Evaluation Framework for Multimedia Recommender Systems

Download
441 downloads
  • @INPROCEEDINGS{10.1007/978-3-642-12630-7_47,
        author={Bart Knijnenburg and Lydia Meesters and Paul Marrow and Don Bouwhuis},
        title={User-Centric Evaluation Framework for Multimedia Recommender Systems},
        proceedings={Workshop Experience Design and Evaluation of Social UCM applications},
        proceedings_a={EXPDES},
        year={2012},
        month={10},
        keywords={},
        doi={10.1007/978-3-642-12630-7_47}
    }
    
  • Bart Knijnenburg
    Lydia Meesters
    Paul Marrow
    Don Bouwhuis
    Year: 2012
    User-Centric Evaluation Framework for Multimedia Recommender Systems
    EXPDES
    Springer
    DOI: 10.1007/978-3-642-12630-7_47
Bart Knijnenburg1,*, Lydia Meesters1,*, Paul Marrow2,*, Don Bouwhuis1,*
  • 1: Technische Universiteit Eindhoven
  • 2: BT Innovate
*Contact email: B.P.Knijnenburg@tue.nl, L.M.J.Meesters@tue.nl, Paul.Marrow@bt.com, D.G.Bouwhuis@tue.nl

Abstract

Providing useful recommendations is an important challenge for user-centric media systems. Whereas current recommender systems research mainly focuses on predictive accuracy, we contend that a truly user-centric approach to media recommendations requires the inclusion of user experience measurement. For a good experience, predictive accuracy is not enough. What users like and dislike about our systems is also determined by usage context and individual user characteristics. We therefore propose a generic framework for evaluating the user experience using both subjective and objective measures of user experience. We envision the framework, which will be tested and validated in the large-scale field trials of the FP7 MyMedia project, to be a fundamental step beyond accuracy of algorithms, towards usability of recommender systems.