RandomLink - Avoiding Linkage-Effects by employing Random Effects for Clustering

RandomLink - Avoiding Linkage-Effects by employing Random Effects for Clustering

Abstract

We present here a new parameter-free clustering algorithm that does not impose any assumptions on the data. Based solely on the premise that close data points are more likely to be in the same cluster, it can autonomously create clusters. Neither the number of clusters nor their shape has to be known. The algorithm is similar to SingleLink in that it connects clusters depending on the distances between data points, but while SingleLink is deterministic, RandomLink makes use of random effects. They help RandomLink overcome the SingleLink-effect (or chain-effect) from which SingleLink suffers as it always connects the closest data points. RandomLink is likely to connect close data points but is not forced to, thus, it can sever chains between clusters. We explain in more detail how this negates the SingleLink-effect and how the use of random effects helps overcome the stiffness of parameters for different distance-based algorithms. We show that the algorithm principle is sound by testing it on different data sets and comparing it with standard clustering algorithms, focusing especially on hierarchical clustering methods.

Grafik Top
Authors
  • Sluiter, Gert
  • Schelling, Benjamin
  • Plant, Claudia
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Paper)
Event Title
31st International Conference on Database and Expert Systems Applications
Divisions
Data Mining and Machine Learning
Event Location
Bratislava, Slovakia
Event Type
Conference
Event Dates
14-17 Sep 2020
Page Range
pp. 217-232
Date
14 September 2020
Export
Grafik Top