EVALUATION OF RECOMMENDER SYSTEMS THROUGH SIMULATED USERS

Miquel Montaner, Beatriz López, Josep Lluís de la Rosa

2004

Abstract

Recommender systems have proved really useful in order to handle with the information overload on the Internet. However, it is very difficult to evaluate such a personalised systems since this involves purely subjective assessments. Actually, only very few recommender systems developed over the Internet evaluate and discuss their results scientifically. The contribution of this paper is a methodology for evaluating recommender systems: the ”profile discovering procedure”. Based on a list of item evaluations previously provided by a real user, this methodology simulates the recommendation process of a recommender system over time. Besides, an extension of this methodology has been designed in order to simulate the collaboration among users. At the end of the simulations, the desired evaluation measures (precision and recall among others) are presented. This methodology and its extensions have been successfully used in the evaluation of different parameters and algorithms of a restaurant recommender system.

Paper Citation

in Harvard Style

Montaner M., López B. and Lluís de la Rosa J. (2004). EVALUATION OF RECOMMENDER SYSTEMS THROUGH SIMULATED USERS . In Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 3: ICEIS, ISBN 972-8865-00-7, pages 303-308. DOI: 10.5220/0002622703030308

in Bibtex Style

@conference{iceis04,
author={Miquel Montaner and Beatriz López and Josep Lluís de la Rosa},
title={EVALUATION OF RECOMMENDER SYSTEMS THROUGH SIMULATED USERS},
booktitle={Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 3: ICEIS,},
year={2004},
pages={303-308},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002622703030308},
isbn={972-8865-00-7},
}

in EndNote Style

TY - CONF
JO - Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 3: ICEIS,
TI - EVALUATION OF RECOMMENDER SYSTEMS THROUGH SIMULATED USERS
SN - 972-8865-00-7
AU - Montaner M.
AU - López B.
AU - Lluís de la Rosa J.
PY - 2004
SP - 303
EP - 308
DO - 10.5220/0002622703030308