Web spam pages use various techniques to achieve
higher-than-deserved rankings in a search engine’s
results. While human experts can identify
spam, it is too expensive to manually evaluate a
large number of pages. Instead, we propose techniques
to semi-automatically separate reputable,
good pages from spam. We first select a small set
of seed pages to be evaluated by an expert. Once
we manually identify the reputable seed pages, we
use the link structure of the web to discover other
pages that are likely to be good. In this paper
we discuss possible ways to implement the seed
selection and the discovery of good pages. We
present results of experiments run on the World
Wide Web indexed by AltaVista and evaluate the
performance of our techniques. Our results show
that we can effectively filter out spam from a significant
fraction of the web, based on a good seed
set of less than 200 sites.
RawSugar is a social search engine powered by user contributions. We're an online community, with over 170,000 URLs already tagged by our members.
Save and organize your favorite webpages along with your notes to share with your friends and community. Publish your directory with RawSugar patented guided search and earn $$. Learn More
R. Jäschke, und S. Rudolph. Contributions to the 11th International Conference on Formal Concept Analysis, Seite 19--34. Technische Universität Dresden, (Mai 2013)
T. Joachims. Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, Seite 133--142. New York, NY, USA, ACM, (2002)
T. Joachims, L. Granka, B. Pan, H. Hembrooke, und G. Gay. Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, Seite 154--161. New York, NY, USA, ACM, (2005)
F. Shipman, III, C. Marshall, und M. LeMere. Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, Seite 121--130. New York, NY, USA, ACM, (1999)
D. Donato, F. Bonchi, T. Chi, und Y. Maarek. Proceedings of the 19th international conference on World wide web, Seite 321--330. New York, NY, USA, ACM, (2010)
B. Yu, und M. Singh. Cooperative Information Agents IV - The Future of Information Agents in Cyberspace, Volume 1860 von Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2000)
B. Yu, und M. Singh. Proceedings of the second international joint conference on Autonomous agents and multiagent systems, Seite 65--72. New York, NY, USA, ACM, (2003)
P. Jurczyk, und E. Agichtein. Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, Seite 919--922. New York, NY, USA, ACM, (2007)