Doerfel, S. & Jäschke, R.: An Analysis of Tag-Recommender Evaluation Procedures. Proceedings of the 7th ACM conference on Recommender systems. New York, NY, USA: ACM, 2013RecSys '13 , S. 343-346
[Volltext]
Since the rise of collaborative tagging systems on the web, the tag recommendation task - suggesting suitable tags to users of such systems while they add resources to their collection - has been tackled. However, the (offline) evaluation of tag recommendation algorithms usually suffers from difficulties like the sparseness of the data or the cold start problem for new resources or users. Previous studies therefore often used so-called post-cores (specific subsets of the original datasets) for their experiments. In this paper, we conduct a large-scale experiment in which we analyze different tag recommendation algorithms on different cores of three real-world datasets. We show, that a recommender's performance depends on the particular core and explore correlations between performances on different cores.

Doerfel, S. & Jäschke, R.: An analysis of tag-recommender evaluation procedures. Proceedings of the 7th ACM conference on Recommender systems. New York, NY, USA: ACM, 2013RecSys '13 , S. 343-346
[Volltext]
Since the rise of collaborative tagging systems on the web, the tag recommendation task - suggesting suitable tags to users of such systems while they add resources to their collection - has been tackled. However, the (offline) evaluation of tag recommendation algorithms usually suffers from difficulties like the sparseness of the data or the cold start problem for new resources or users. Previous studies therefore often used so-called post-cores (specific subsets of the original datasets) for their experiments. In this paper, we conduct a large-scale experiment in which we analyze different tag recommendation algorithms on different cores of three real-world datasets. We show, that a recommender's performance depends on the particular core and explore correlations between performances on different cores.

Mitzlaff, F.; Atzmüller, M.; Benz, D.; Hotho, A. & Stumme, G.: Community Assessment using Evidence Networks. Proceedings of the Workshop on Mining Ubiquitous and Social Environments (MUSE2010). Barcelona, Spain: 2010
[Volltext]
Community mining is a prominent approach for identifying (user) communities in social and ubiquitous contexts. While there are a variety of methods for community mining and detection, the effective evaluation and validation of the mined communities is usually non-trivial. Often there is no evaluation data at hand in order to validate the discovered groups. This paper proposes evidence networks using implicit information for the evaluation of communities. The presented evaluation approach is based on the idea of reconstructing existing social structures for the assessment and evaluation of a given clustering. We analyze and compare the presented evidence networks using user data from the real-world social
okmarking application BibSonomy. The results indicate that the evidence
tworks reflect the relative rating of the explicit ones very well.

Mitzlaff, F.; Atzmüller, M.; Benz, D.; Hotho, A. & Stumme, G.: Community Assessment using Evidence Networks. Proceedings of the Workshop on Mining Ubiquitous and Social Environments (MUSE2010). Barcelona, Spain: 2010
[Volltext]
Community mining is a prominent approach for identifying (user) communities in social and ubiquitous contexts. While there are a variety of methods for community mining and detection, the effective evaluation and validation of the mined communities is usually non-trivial. Often there is no evaluation data at hand in order to validate the discovered groups. This paper proposes evidence networks using implicit information for the evaluation of communities. The presented evaluation approach is based on the idea of reconstructing existing social structures for the assessment and evaluation of a given clustering. We analyze and compare the presented evidence networks using user data from the real-world social
okmarking application BibSonomy. The results indicate that the evidence
tworks reflect the relative rating of the explicit ones very well.