Evaluation of Hierarchical Clustering Algorithms for Document Datasets
| Ying Zhao and George Karypis |
| 11th Conference of Information and Knowledge Management (CIKM), pp. 515-524, 2002 |
Download Paper  |
| Abstract Fast and high-quality document clustering algorithms play an important role in providing intuitive navigation and browsing mechanisms by organizing large amounts of information into a small number of meaningful clusters. In particular, hierarchical clustering solutions provide a view of the data at different levels of granularity, making them ideal for people to visualize and interactively explore large document collections. The focus of this paper is to evaluate different hierarchical clustering algorithms and toward this goal we compared various partitional and agglomerative approaches. Our experimental evaluation showed that partitional algorithms always lead to better clustering solutions than agglomerative algorithms, which suggests that partitional clustering algorithms are well-suited for clustering large document datasets due to not only their relatively low computational requirements, but also comparable or even better clustering performance. We also present a new class of clustering algorithms called constrained agglomerative algorithms that combine the features of both partitional and agglomerative algorithms. Our experimental results showed that they consistently lead to better hierarchical solutions than agglomerative or partitional algorithms alone. |
| Comments The algorithms in this paper are part of [hlink:[views/cluto][CLUTO]]. |
| Research topics: Clustering | CLUTO | Data mining | Text mining |