Research Article
User-Centric Evaluation Framework for Multimedia Recommender Systems
@INPROCEEDINGS{10.1007/978-3-642-12630-7_47, author={Bart Knijnenburg and Lydia Meesters and Paul Marrow and Don Bouwhuis}, title={User-Centric Evaluation Framework for Multimedia Recommender Systems}, proceedings={Workshop Experience Design and Evaluation of Social UCM applications}, proceedings_a={EXPDES}, year={2012}, month={10}, keywords={}, doi={10.1007/978-3-642-12630-7_47} }- Bart Knijnenburg
Lydia Meesters
Paul Marrow
Don Bouwhuis
Year: 2012
User-Centric Evaluation Framework for Multimedia Recommender Systems
EXPDES
Springer
DOI: 10.1007/978-3-642-12630-7_47
Abstract
Providing useful recommendations is an important challenge for user-centric media systems. Whereas current recommender systems research mainly focuses on predictive accuracy, we contend that a truly user-centric approach to media recommendations requires the inclusion of user experience measurement. For a good experience, predictive accuracy is not enough. What users like and dislike about our systems is also determined by usage context and individual user characteristics. We therefore propose a generic framework for evaluating the user experience using both subjective and objective measures of user experience. We envision the framework, which will be tested and validated in the large-scale field trials of the FP7 MyMedia project, to be a fundamental step beyond accuracy of algorithms, towards usability of recommender systems.
