Lorince, J.; Joseph, K. & Todd, P. (2015), Analysis of Music Tagging and Listening Patterns: Do Tags Really Function as Retrieval Aids?, in Nitin Agarwal; Kevin Xu & Nathaniel Osgood, ed., 'Social Computing, Behavioral-Cultural Modeling, and Prediction' , Springer International Publishing, , pp. 141-152 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

In collaborative tagging systems, it is generally assumed that users assign tags to facilitate retrieval of content at a later time. There is, however, little behavioral evidence that tags actually serve this purpose. Using a large-scale dataset from the social music website Last.fm, we explore how patterns of music tagging and subsequent listening interact to determine if there exist measurable signals of tags functioning as retrieval aids. Specifically, we describe our methods for testing if the assignment of a tag tends to lead to an increase in listening behavior. Results suggest that tagging, on average, leads to only very small increases in listening rates, and overall the data do

Doerfel, S.; Zoller, D.; Singer, P.; Niebler, T.; Hotho, A. & Strohmaier, M. (2014), Evaluating Assumptions about Social Tagging - A Study of User Behavior
in BibSonomy, in Thomas Seidl; Marwan Hassani & Christian Beecks, ed., 'Proceedings of the 16th LWA Workshops: KDML, IR and FGWM, Aachen, Germany, September 8-10, 2014.' , CEUR-WS.org, , pp. 18--19 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Doerfel, S.; Zoller, D.; Singer, P.; Niebler, T.; Hotho, A. & Strohmaier, M. (2014), How Social is Social Tagging?, in 'Proceedings of the 23rd International World Wide Web Conference' , ACM, New York, NY, USA .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Kaur, J.; JafariAsbagh, M.; Radicchi, F. & Menczer, F. (2014), Scholarometer: A System for Crowdsourcing Scholarly Impact Metrics, in 'Proceedings of the 2014 ACM Conference on Web Science' , ACM, New York, NY, USA , pp. 285--286 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Scholarometer (scholarometer.indiana.edu) is a social tool developed to facilitate citation analysis and help evaluate the impact of authors. The Scholarometer service allows scholars to compute various citation-based impact measures. In exchange, users provide disciplinary annotations of authors, which allow for the computation of discipline-specific statistics and discipline-neutral impact metrics. We present here two improvements of our system. First, we integrated a new universal impact metric hs that uses crowdsourced data to calculate the global rank of a scholar across disciplinary boundaries. Second, improvements made in ambiguous name classification have increased the accuracy from 80% to 87%.

Kowald, D.; Seitlinger, P.; Trattner, C. & Ley, T. (2014), Long Time No See: The Probability of Reusing Tags As a Function of Frequency and Recency, in 'Proceedings of the Companion Publication of the 23rd International Conference on World Wide Web Companion' , International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland , pp. 463--468 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

In this paper, we introduce a tag recommendation algorithm that mimics the way humans draw on items in their long-term memory. This approach uses the frequency and recency of previous tag assignments to estimate the probability of reusing a particular tag. Using three real-world folksonomies gathered from bookmarks in BibSonomy, CiteULike and Flickr, we show how incorporating a time-dependent component outperforms conventional "most popular tags" approaches and another existing and very effective but less theory-driven, time-dependent recommendation mechanism. By combining our approach with a simple resource-specific frequency analysis, our algorithm outperforms other well-established algorithms, such as FolkRank, Pairwise Interaction Tensor Factorization and Collaborative Filtering. We conclude that our approach provides an accurate and computationally efficient model of a user's temporal tagging behavior. We demonstrate how effective principles of information retrieval can be designed and implemented if human memory processes are taken into account.

2012

Li, X.; Thelwall, M. & Giustini, D. (2012), 'Validating online reference managers for scholarly impact measurement', Scientometrics 91 (2) , 461-471 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

This paper investigates whether CiteULike and Mendeley are useful for measuring scholarly influence, using a sample of 1,613 papers published in Nature and Science in 2007. Traditional citation counts from the Web of Science (WoS) were used as benchmarks to compare with the number of users who bookmarked the articles in one of the two free online reference manager sites. Statistically significant correlations were found between the user counts and the corresponding WoS citation counts, suggesting that this type of influence is related in some way to traditional citation-based scholarly impact but the number of users of these systems seems to be still too small for them to challenge traditional citation indexes.

2011

Haustein, S. & Siebenlist, T. (2011), 'Applying social bookmarking data to evaluate journal usage ', Journal of Informetrics 5 (3) , 446 - 457 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Web 2.0 technologies are finding their way into academics: specialized social bookmarking services allow researchers to store and share scientific literature online. By bookmarking and tagging articles, academic prosumers generate new information about resources, i.e. usage statistics and content description of scientific journals. Given the lack of global download statistics, the authors propose the application of social bookmarking data to journal evaluation. For a set of 45 physics journals all 13,608 bookmarks from CiteULike, Connotea and BibSonomy to documents published between 2004 and 2008 were analyzed. This article explores bookmarking data in STM and examines in how far it can be used to describe the perception of periodicals by the readership. Four basic indicators are defined, which analyze different aspects of usage: Usage Ratio, Usage Diffusion, Article Usage Intensity and Journal Usage Intensity. Tags are analyzed to describe a reader-specific view on journal content.

Mitzlaff, F.; Atzmueller, M.; Benz, D.; Hotho, A. & Stumme, G. (2011), Community Assessment Using Evidence Networks, in Martin Atzmueller; Andreas Hotho; Markus Strohmaier & Alvin Chin, ed., 'Analysis of Social Media and Ubiquitous Data' , Springer Berlin Heidelberg, , pp. 79-98 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Stiller, J.; Gäde, M. & Petras, V. (2011), Is Tagging Multilingual?: A Case Study with BibSonomy, in 'Proceedings of the 11th Annual International ACM/IEEE Joint Conference on Digital Libraries' , ACM, New York, NY, USA , pp. 421--422 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

This paper investigates the occurrence of tags in different languages in a collaborative bookmarking and publication sharing service - BibSonomy. Social tags assigned to URLs in multiple languages and users tagging these URLs multilingually are the main focus of this study. The results show that multilingual tags occur for the same URL and that users tag in different languages. Furthermore, the results give indications that the language of the content of a URL does not imply that its tags are in the same language.

2010

Lipczak, M. & Milios, E. (2010), The Impact of Resource Title on Tags in Collaborative Tagging Systems, in 'Proceedings of the 21st ACM Conference on Hypertext and Hypermedia' , ACM, New York, NY, USA , pp. 179--188 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Collaborative tagging systems are popular tools for organization, sharing and retrieval of web resources. Their success is due to their freedom and simplicity of use. To post a resource, the user should only define a set of tags that would position the resource in the system's data structure -- folksonomy. This data structure can serve as a rich source of information about relations between tags and concepts they represent. To make use of information collaboratively added to folksonomies, we need to understand how users make tagging decisions. Three factors that are believed to influence user tagging decisions are: the tags used by other users, the organization of user's personal repository and the knowledge model shared between users. In our work we examine the role of another potential factor -- resource title. Despite all the advantages of tags, tagging is a tedious process. To minimize the effort, users are likely to tag with keywords that are easily available. We show that resource title, as a source of useful tags, is easy to access and comprehend. Given a choice of two tags with the same meaning, users are likely to be influenced by their presence in the title. However, a factor that seems to have stronger impact on users' tagging decisions is maintaining the consistency of the personal profile of tags. The results of our study reveal a new, less idealistic picture of collaborative tagging systems, in which the collaborative aspect seems to be less important than personal gains and convenience.

2008

Glushko, R. J.; Maglio, P. P.; Matlock, T. & Barsalou, L. W. (2008), 'Categorization in the wild ', Trends in Cognitive Sciences 12 (4) , 129 - 135 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

In studying categorization, cognitive science has focused primarily on cultural categorization, ignoring individual and institutional categorization. Because recent technological developments have made individual and institutional classification systems much more available and powerful, our understanding of the cognitive and social mechanisms that produce these systems is increasingly important. Furthermore, key aspects of categorization that have received little previous attention emerge from considering diverse types of categorization together, such as the social factors that create stability in classification systems, and the interoperability that shared conceptual systems establish between agents. Finally, the profound impact of recent technological developments on classification systems indicates that basic categorization mechanisms are highly adaptive, producing new classification systems as the situations in which they operate change.

Noy, N. F.; Chugh, A. & Alani, H. (2008), 'The CKC Challenge: Exploring Tools for Collaborative Knowledge Construction', IEEE Intell Syst 23 (1) , 64-68 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

The great success of Web 2.0 is mainly fuelled by an infrastructure that allows web users to create, share, tag, and connect content and knowledge easily. The tools for developing structured knowledge in this manner have started to appear as well. However, there are few, if any, user studies that are aimed at understanding what users expect from such tools, what works and what doesn't. We organized the Collaborative Knowledge Construction (CKC) Challenge to assess the state of the art for the tools that support collaborative processes for creation of various forms of structured knowledge. The goal of the Challenge was to get users to try out different tools and to learn what users expect from such tools-features that users need, features that they like or dislike. The Challenge task was to construct structured knowledge for a portal that would provide information about research. The Challenge design contained several incentives for users to participate. Forty-nine users registered for the Challenge; thirty-three of them participated actively by using the tools. We collected extensive feedback from the users where they discussed their thoughts on all the tools that they tried. In this paper, we present the results of the Challenge, discuss the features that users expect from tools for collaborative knowledge constructions, the features on which Challenge participants disagreed, and the lessons that we learned.

Saeed, A.; Afzal, M.; Latif, A. & Tochtermann, K. (2008), Citation rank prediction based on bookmark counts: Exploratory case study of WWW06 papers, in 'Multitopic Conference, 2008. INMIC 2008. IEEE International' , pp. 392-397 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

New developments in the collaborative and participatory role of Web has emerged new web based fast lane information systems like tagging and bookmarking applications. Same authors have shown elsewhere, that for same papers tags and bookmarks appear and gain volume very quickly in time as compared to citations and also hold good correlation with the citations. Studying the rank prediction models based on these systems gives advantage of gaining quick insight and localizing the highly productive and diffusible knowledge very early in time. This shows that it may be interesting to model the citation rank of a paper within the scope of a conference or journal issue, based on the bookmark counts (i-e count representing how many researchers have shown interest in a publication.) We used linear regression model for predicting citation ranks and compared both predicted citation rank models of bookmark counts and coauthor network counts for the papers of WWW06 conference. The results show that the rank prediction model based on bookmark counts is far better than the one based on coauthor network with mean absolute error for the first limited to the range of 5 and mean absolute error for second model above 18. Along with this we also compared the two bookmark prediction models out of which one was based on total citations rank as a dependent variable and the other was based on the adjusted citation rank. The citation rank was adjusted after subtracting the self and coauthor citations from total citations. The comparison reveals a significant improvement in the model and correlation after adjusting the citation rank. This may be interpreted that the bookmarking mechanisms represents the phenomenon similar to global discovery of a publication. While in the coauthor nets the papers are communicated personally and this communication or selection may not be captured within the bookmarking systems.

2007

Ames, M. & Naaman, M. (2007), Why We Tag: Motivations for Annotation in Mobile and Online Media, in 'Proceedings of the SIGCHI Conference on Human Factors in Computing Systems' , ACM, New York, NY, USA , pp. 971--980 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Why do people tag? Users have mostly avoided annotating media such as photos -- both in desktop and mobile environments -- despite the many potential uses for annotations, including recall and retrieval. We investigate the incentives for annotation in Flickr, a popular web-based photo-sharing system, and ZoneTag, a cameraphone photo capture and annotation tool that uploads images to Flickr. In Flickr, annotation (as textual tags) serves both personal and social purposes, increasing incentives for tagging and resulting in a relatively high number of annotations. ZoneTag, in turn, makes it easier to tag cameraphone photos that are uploaded to Flickr by allowing annotation and suggesting relevant tags immediately after capture. A qualitative study of ZoneTag/Flickr users exposed various tagging patterns and emerging motivations for photo annotation. We offer a taxonomy of motivations for annotation in this system along two dimensions (sociality and function), and explore the various factors that people consider when tagging their photos. Our findings suggest implications for the design of digital photo organization and sharing applications, as well as other applications that incorporate user-based annotation.

2006

Golder, S. A. & Huberman, B. A. (2006), 'Usage patterns of collaborative tagging systems', Journal of Information Science 32 (2) , 198-208 .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Collaborative tagging describes the process by which many users add metadata in the form of keywords to shared content. Recently, collaborative tagging has grown in popularity on the web, on sites that allow users to tag bookmarks, photographs and other content. In this paper we analyze the structure of collaborative tagging systems as well as their dynamic aspects. Specifically, we discovered regularities in user activity, tag frequencies, kinds of tags used, bursts of popularity in bookmarking and a remarkable stability in the relative proportions of tags within a given URL. We also present a dynamic model of collaborative tagging that predicts these stable patterns and relates them to imitation and shared knowledge.

Millen, D. R. & Feinberg, J. (2006), Using Social Tagging to Improve Social Navigation, in 'Workshop on the Social Navigation and Community based Adaptation Technologies' .
[Volltext] [Kurzfassung] [BibTeX] [Endnote]

Abstract. In this paper, we explore the increasingly popular social bookmarking services. These services powerfully combine personal tagging of information sources with interactive browsing, which allows for improved social navigation. We examine the use of a social bookmarking service, deployed in a large organization, to understand how social navigation is supported. We conclude that social tags used in the context of a social bookmarking service are an important way to improve social navigation. 1