Java, A.; Joshi, A. & FininBook, T. (2008), Approximating the Community Structure of the Long Tail, in 'Proceedings of the Second International Conference on Weblogs and Social Media(ICWSM 2008)' , AAAI Press, .
[BibTeX] [Endnote]

In many social media applications, a small fraction of the members are highly linked while most are sparsely connected to the network. Such a skewed distribution is sometimes referred to as the"long tail". Popular applications like meme trackers and content aggregators mine for information from only the popular blogs located at the head of this curve. On the other hand, the long tail contains large volumes of interesting information and niches. The question we address in this work is how best to approximate the community membership of entities in the long tail using only a small percentage of the entire graph structure. Our technique utilizes basic linear algebra manipulations and spectral methods. It has the advantage of quickly and efficiently finding a reasonable approximation of the community structure of the overall network. Such a method has significant applications in blog analysis engines as well as social media monitoring tools in general.

Drineas, P.; Frieze, A.; Kannan, R.; Vempala, S. & Vinay, V. (2004), 'Clustering large graphs via the singular value decomposition', Machine Learning 56 (1) , 9--33 .
[BibTeX] [Endnote]

Ke, Q. & Kanade, T. (2004), Robust Subspace Clustering by Combined Use of kNND Metric and SVD Algorithm., in 'CVPR (2)' , pp. 592-599 .
[BibTeX] [Endnote]

Osinski, S.; Stefanowski, J. & Weiss, D. (2004), Lingo: Search Results Clustering Algorithm Based on Singular Value Decomposition, in 'Intelligent Information Systems' , pp. 359-368 .
[BibTeX] [Endnote]

2000

Aggarwal, C. C. & Yu, P. S. (2000), Finding Generalized Projected Clusters In High Dimensional Spaces, in Weidong Chen; Jeffrey F. Naughton & Philip A. Bernstein, ed., 'Proceedings of the 2000 ACM SIGMOD International Conference on
Management of Data, May 16-18, 2000, Dallas, Texas, USA' , ACM, , pp. 70-81 .
[BibTeX] [Endnote]

1999

Kleinberg, J. M. (1999), 'Authoritative sources in a hyperlinked environment', Journal of the ACM 46 (5) , 604--632 .
[BibTeX] [Endnote]

. The network structure of a hyperlinked environment can be a rich source of information about the content of the environment, provided we have effective means for understanding it. We develop a set of algorithmic tools for extracting information from the link structures of such environments, and report on experiments that demonstrate their effectiveness in a variety of contexts on the World Wide Web. The central issue we address within our framework is the distillation of broad search topics,...

1998

Gibson, D.; Kleinberg, J. & Raghavan, P. (1998), Clustering Categorical Data: An Approach Based on Dynamical Systems, in , pp. 311--322 .
[BibTeX] [Endnote]

We describe a novel approach for clustering collections of sets, and its application to the analysis and mining of categorical data. By "categorical data," we mean tables with fields that cannot be naturally ordered by a metric --- e.g., the names of producers of automobiles, or the names of products offered by a manufacturer. Our approach is based on an iterative method for assigning and propagating weights on the categorical values in a table; this facilitates a type of similarity measure arising from the cooccurrence of values in the dataset. Our techniques can be studied analytically in terms of certain types of non-linear dynamical systems. We discuss experiments on a variety of tables of synthetic and real data; we find that our iterative methods converge quickly to prominently correlated values of various categorical fields. 1 Introduction Much of the data in databases is categorical: fields in tables whose attributes cannot naturally be ordered as numerical values can. The pro...

1997

Boley, D. (1997), 'Principal Direction Divisive Partitioning', Data Mining and Knowledge Discovery 2 , 325--344 .
[BibTeX] [Endnote]

We propose a new algorithm capable of partitioning a set of documents or other samples based on an embedding in a high dimensional Euclidean space (i.e. in which every document is a vector of real numbers). The method is unusual in that it is divisive, as opposed to agglomerative, and operates by repeatedly splitting clusters into smaller clusters. The splits are not based on any distance or similarity measure. The documents are assembled in to a matrix which is very sparse. It is this sparsity that permits the algorithm to be very efficient. The performance of the method is illustrated with a set of text documents obtained from the World Wide Web. Some possible extensions are proposed for further investigation.

1994

Berry, M. W.; Dumais, S. T. & O'Brien, G. W. (1994), 'Using Linear Algebra for Intelligent Information Retrieval' (UT-CS-94-270) , Technical report, Computer Science Department, University of Tennessee, Knoxville .
[BibTeX] [Endnote]