Artigo em revista científica
Clustering stability and ground truth: numerical experiments
Maria José Amorim (Amorim, M. J.); Margarida G. M. S. Cardoso (Cardoso, M. G. M. S.);
Título Revista
International Journal of Artificial Intelligence and Knowledge Discovery
Ano (publicação definitiva)
2015
Língua
Inglês
País
Índia
Mais Informação
Web of Science®

Esta publicação não está indexada na Web of Science®

Scopus

Esta publicação não está indexada na Scopus

Google Scholar

Esta publicação não está indexada no Google Scholar

Abstract/Resumo
Stability has been considered an important property for evaluating clustering solutions. Nevertheless, there are no conclusive studies on the relationship between this property and the capacity to recover clusters inherent to data (“ground truth”). This study focuses on this relationship, resorting to experiments on synthetic data generated under diverse scenarios (controlling relevant factors) and experiments on real data sets. Stability is evaluated using a weighted cross-validation procedure. Indices of agreement (corrected for agreement by chance) are used both to assess stability and external validity. The results obtained reveal a new perspective so far not mentioned in the literature. Despite the clear relationship between stability and external validity when a broad range of scenarios is considered, the within-scenarios conclusions deserve our special attention: faced with a specific clustering problem (as we do in practice), there is no significant relationship between clustering stability and the ability to recover data clusters
Agradecimentos/Acknowledgements
--
Palavras-chave
Clustering,External validation,Stability
Registos de financiamentos
Referência de financiamento Entidade Financiadora
UID/GES/00315/2013 Fundação para a Ciência e a Tecnologia