Tracking evolving communities in large linked networks

AUTOR(ES)

Hopcroft, John

FONTE

National Academy of Sciences

RESUMO

We are interested in tracking changes in large-scale data by periodically creating an agglomerative clustering and examining the evolution of clusters (communities) over time. We examine a large real-world data set: the NEC CiteSeer database, a linked network of >250,000 papers. Tracking changes over time requires a clustering algorithm that produces clusters stable under small perturbations of the input data. However, small perturbations of the CiteSeer data lead to significant changes to most of the clusters. One reason for this is that the order in which papers within communities are combined is somewhat arbitrary. However, certain subsets of papers, called natural communities, correspond to real structure in the CiteSeer database and thus appear in any clustering. By identifying the subset of clusters that remain stable under multiple clustering runs, we get the set of natural communities that we can track over time. We demonstrate that such natural communities allow us to identify emerging communities and track temporal changes in the underlying structure of our network data.

Documentos Relacionados

• Defining and identifying communities in networks
• A model for the emergence of cooperation, interdependence, and structure in evolving networks
• An evolving model of undirected networks based on microscopic biological interaction systems
• The small world inside large metabolic networks.
• Activation of RNA polymerase II by topologically linked DNA-tracking proteins