Publications
Distributional measures as proxies for semantic relatedness
Mohammad, S. & Hirst, G.
(Submitted for publication) [pdf]
Text Mining Scientific Papers: A Survey on FCA-Based Information Retrieval Research
Poelmans, J.; Ignatov, D.; Viaene, S.; Dedene, G. & Kuznetsov, S.
Perner, P., ed., 'Advances in Data Mining. Applications and Theoretical Aspects', 7377(), Springer Berlin Heidelberg, 273-287 (2012) [pdf]
Formal Concept Analysis (FCA) is an unsupervised clustering technique and many scientific papers are devoted to applying FCA in Information Retrieval (IR) research. We collected 103 papers published between 2003-2009 which mention FCA and information retrieval in the abstract, title or keywords. Using a prototype of our FCA-based toolset CORDIET, we converted the pdf-files containing the papers to plain text, indexed them with Lucene using a thesaurus containing terms related to FCA research and then created the concept lattice shown in this paper. We visualized, analyzed and explored the literature with concept lattices and discovered multiple interesting research streams in IR of which we give an extensive overview. The core contributions of this paper are the innovative application of FCA to the text mining of scientific papers and the survey of the FCA-based IR research.
Machine Learnability Analysis of Textclassifications in a Social Bookmarking Folksonomy
Illig, J.
2008, Master's thesis, University of Kassel, Bachelor Thesis
Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis
Cimiano, P.; Hotho, A. & Staab, S.
Journal on Artificial Intelligence Research, 24() 305-339 (2005) [pdf]
Wordnet improves text document clustering
Hotho, A.; Staab, S. & Stumme, G.
, 'Proc. SIGIR Semantic Web Workshop', Toronto (2003) [pdf]
Explaining Text Clustering Results using Semantic Structures
Hotho, A.; Staab, S. & Stumme, G.
Lavrač, N.; Gamberger, D. & Todorovski, H. B., ed., 'Knowledge Discovery in Databases: PKDD 2003, 7th European Conference on Principles and Practice of Knowledge Discovery in Databases', 2838(), LNAI, Springer, Heidelberg, 217-228 (2003) [pdf]
Common text clustering techniques offer rather poor capabilities
r explaining to their users why a particular result has been
hieved. They have the disadvantage that they do not relate
mantically nearby terms and that they cannot explain how
sulting clusters are related to each other.
n this paper, we discuss a way of integrating a large thesaurus
nd the computation of lattices of resulting clusters into common text clustering
n order to overcome these two problems.
its major result, our approach achieves an explanation using an
propriate level of granularity at the concept level as well as
appropriate size and complexity of the explaining lattice of
sulting clusters.
Ontologies improve text document clustering
Hotho, A.; Staab, S. & Stumme, G.
, 'Proceedings of the 2003 IEEE International Conference on Data Mining', IEEE Computer Society, Melbourne, Florida, 541-544 (Poster (2003) [pdf]
Text Clustering Based on Background Knowledge
Hotho, A.; Staab, S. & Stumme, G.
2003, 425(), Technical report, University of Karlsruhe, Institute AIFB [pdf]
Text document clustering plays an important role in providing intuitive
vigation and browsing mechanisms by organizing large amounts of information
to a small number of meaningful clusters. Standard partitional or agglomerative
ustering methods efficiently compute results to this end.
wever, the bag of words representation used for these clustering methods is often
satisfactory as it ignores relationships between important terms that do not
-occur literally. Also, it is mostly left to the user to find out why a particular partitioning
s been achieved, because it is only specified extensionally. In order to
al with the two problems, we integrate background knowledge into the process of
ustering text documents.
rst, we preprocess the texts, enriching their representations by background knowledge
ovided in a core ontology — in our application Wordnet. Then, we cluster
e documents by a partitional algorithm. Our experimental evaluation on Reuters
wsfeeds compares clustering results with pre-categorizations of news. In the experiments,
provements of results by background knowledge compared to the baseline
n be shown for many interesting tasks.
cond, the clustering partitions the large number of documents to a relatively small
mber of clusters, which may then be analyzed by conceptual clustering. In our approach,
applied Formal Concept Analysis. Conceptual clustering techniques are
own to be too slow for directly clustering several hundreds of documents, but they
ve an intensional account of cluster results. They allow for a concise description
commonalities and distinctions of different clusters. With background knowledge
ey even find abstractions like “food” (vs. specializations like “beef” or “corn”).
us, in our approach, partitional clustering reduces first the size of the problem
ch that it becomes tractable for conceptual clustering, which then facilitates the
derstanding of the results.
Conceptual Clustering of Text Clusters
Hotho, A. & Stumme, G.
Kókai, G. & Zeidler, J., ed., 'Proc. Fachgruppentreffen Maschinelles Lernen (FGML 2002)', 37-45 (2002) [pdf]