Latent Dirichlet Allocation for Automatic Document Categorization.
Machine Learning and Knowledge Discovery in Databases:430-441, 2009.
István Bíró und Jácint Szabó.
[doi]
[Kurzfassung]
[BibTeX]
In this paper we introduce and evaluate a technique for applying latent Dirichlet allocation to supervised semantic categorization
of documents. In our setup, for every category an own collection of topics is assigned, and for a labeled training documentonly topics from its category are sampled. Thus, compared to the classical LDA that processes the entire corpus in one, weessentially build separate LDA models for each category with the category-specific topics, and then these topic collectionsare put together to form a unified LDA model. For an unseen document the inferred topic distribution gives an estimation howmuch the document fits into the category.
Web Spam: a Survey with Vision for the Archivist.
In:
Proceedings of the 8th International Web Archiving Workshop IWAW'08.
Aaarhus, Denmark, 2008.
András A. Benczúr, Dávid Siklósi, Jácint Szabó, István Bíró, Zsolt Fekete, Miklós Kurucz, Attila Pereszlényi, Simon Rácz und Adrienn Szabó.
[doi]
[Kurzfassung]
[BibTeX]
While Web archive quality is endangered by Web spam, a side effect of the high commercial value of top-ranked search-engine results, so farWeb spam filtering technologies are rarely used byWeb archivists. In this paper we make the first attempt to disseminate existing methodology and envision a solution for Web archives to share knowledge and unite efforts in Web spam hunting. We survey the state of the art inWeb spam filtering illustrated by the recent Web spam challenge data sets and techniques and describe the filtering solution for archives envisioned in the LiWA—Living Web Archives project.