Volume 91, Number 4, August 2010
|Number of page(s)||6|
|Section||Interdisciplinary Physics and Related Areas of Science and Technology|
|Published online||15 September 2010|
The effect of discrete vs. continuous-valued ratings on reputation and ranking systems
Département de Physique, Université de Fribourg - Chemin du Musée 3, CH-1700 Fribourg, Switzerland
2 Institut Jean Nicod (CNRS) - 29 rue d'Ulm, F-75005 Paris, France, EU
3 CREATE-NET Research Consortium - via alla Cascata 56D, I-38123 Povo di Trento, Italy, EU
Accepted: 9 August 2010
When users rate objects, a sophisticated algorithm that takes into account ability or reputation may produce a fairer or more accurate aggregation of ratings than the straightforward arithmetic average. Recently a number of authors have proposed different co-determination algorithms where estimates of user and object reputation are refined iteratively together, permitting accurate measures of both to be derived directly from the rating data. However, simulations demonstrating these methods' efficacy assumed a continuum of rating values, consistent with typical physical modelling practice, whereas in most actual rating systems only a limited range of discrete values (such as a 5-star system) is employed. We perform a comparative test of several co-determination algorithms with different scales of discrete ratings and show that this seemingly minor modification in fact has a significant impact on algorithms' performance. Paradoxically, where rating resolution is low, increased noise in users' ratings may even improve the overall performance of the system.
PACS: 89.20.Ff – Computer science and technology / 89.65.-s – Social and economic systems / 89.20.Hh – World Wide Web, Internet
© EPLA, 2010
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.