Talk
Clustering aggregated data: the use of distances on distribution laws
Margarida G. M. S. Cardoso (Cardoso, M. G. M. S.);
Event Title
10th International Conference of the ERCIM WG on Computational and Methodological Statistics (CMStatistics 2017)
Year (definitive publication)
2017
Language
English
Country
United Kingdom
More Information
Web of Science®

This publication is not indexed in Web of Science®

Scopus

This publication is not indexed in Scopus

Google Scholar

This publication is not indexed in Google Scholar

Abstract
Big data can be reduced into aggregated data using common summary statistics. The use of clustering procedures for aggregated data should, naturally, rely on adequate distances to compute heterogeneity between aggregated observations – e.g. considering histogram data. In this setting, distances on distribution laws can be particularly useful, although little work has been done in this area. A clustering analysis is conducted illustrating the use of three distances based on distribution laws on aggregated data. The data set considered originates from the European Social Survey and regards human values across regions in Europe. A K-Medoids algorithm is used. The results obtained are compared based on several indicators: e.g. within-between clusters average distance, average silhouette width, Calinski and Harabasz index and Dunn index. A congruent evaluation is conducted using the same distances both to build the clusters and evaluate them. In addition, indicators are also computed based on the commonly used Euclidean distance. Discussion refers to the choice a particular clustering solution.
Acknowledgements
--
Keywords
Clustering,Symbolic Data,European Social Survey