ID: 1205.1813

Graph spectra and the detectability of community structure in networks

May 8, 2012

View on ArXiv
Raj Rao Nadakuditi, M. E. J. Newman
Computer Science
Condensed Matter
Physics
Social and Information Netwo...
Statistical Mechanics
Physics and Society

We study networks that display community structure -- groups of nodes within which connections are unusually dense. Using methods from random matrix theory, we calculate the spectra of such networks in the limit of large size, and hence demonstrate the presence of a phase transition in matrix methods for community detection, such as the popular modularity maximization method. The transition separates a regime in which such methods successfully detect the community structure from one in which the structure is present but is not detected. By comparing these results with recent analyses of maximum-likelihood methods we are able to show that spectral modularity maximization is an optimal detection method in the sense that no other method will succeed in the regime where the modularity method fails.

Similar papers 1

Phase Transitions in Spectral Community Detection

September 10, 2014

93% Match
Pin-Yu Chen, Alfred O. III Hero
Social and Information Netwo...
Physics and Society

Consider a network consisting of two subnetworks (communities) connected by some external edges. Given the network topology, the community detection problem can be cast as a graph partitioning problem that aims to identify the external edges as the graph cut that separates these two subnetworks. In this paper, we consider a general model where two arbitrarily connected subnetworks are connected by random external edges. Using random matrix theory and concentration inequalitie...

Find SimilarView on arXiv

Spectra of random graphs with community structure and arbitrary degrees

September 30, 2013

93% Match
Xiao Zhang, Raj Rao Nadakuditi, M. E. J. Newman
Social and Information Netwo...
Statistical Mechanics
Physics and Society

Using methods from random matrix theory researchers have recently calculated the full spectra of random networks with arbitrary degrees and with community structure. Both reveal interesting spectral features, including deviations from the Wigner semicircle distribution and phase transitions in the spectra of community structured networks. In this paper we generalize both calculations, giving a prescription for calculating the spectrum of a network with both community structur...

Find SimilarView on arXiv

Finding community structure in networks using the eigenvectors of matrices

May 10, 2006

93% Match
M. E. J. Newman
Data Analysis, Statistics an...
Statistical Mechanics
Physics and Society

We consider the problem of detecting communities or modules in networks, groups of vertices with a higher-than-average density of edges connecting them. Previous work indicates that a robust approach to this problem is the maximization of the benefit function known as "modularity" over possible divisions of a network. Here we show that this maximization process can be written in terms of the eigenspectrum of a matrix we call the modularity matrix, which plays a role in commun...

Find SimilarView on arXiv

Improved spectral algorithm for the detection of network communities

April 8, 2005

92% Match
L. Donetti, M. A. Munoz
Physics and Society
Statistical Mechanics

We review and improve a recently introduced method for the detection of communities in complex networks. This method combines spectral properties of some matrices encoding the network topology, with well known hierarchical clustering techniques, and the use of the modularity parameter to quantify the goodness of any possible community subdivision. This provides one of the best available methods for the detection of community structures in complex systems.

Find SimilarView on arXiv

Spectral methods for network community detection and graph partitioning

July 29, 2013

92% Match
M. E. J. Newman
Physics and Society
Statistical Mechanics
Social and Information Netwo...
Data Analysis, Statistics an...

We consider three distinct and well studied problems concerning network structure: community detection by modularity maximization, community detection by statistical inference, and normalized-cut graph partitioning. Each of these problems can be tackled using spectral algorithms that make use of the eigenvectors of matrix representations of the network. We show that with certain choices of the free parameters appearing in these spectral algorithms the algorithms for all three...

Find SimilarView on arXiv

Modularity and community structure in networks

February 17, 2006

92% Match
M. E. J. Newman
Data Analysis, Statistics an...
Statistical Mechanics
Physics and Society

Many networks of interest in the sciences, including a variety of social and biological networks, are found to divide naturally into communities or modules. The problem of detecting and characterizing this community structure has attracted considerable recent attention. One of the most sensitive detection methods is optimization of the quality function known as "modularity" over the possible divisions of a network, but direct application of this method using, for instance, si...

Find SimilarView on arXiv

The Computer Science and Physics of Community Detection: Landscapes, Phase Transitions, and Hardness

February 1, 2017

92% Match
Cristopher Moore
Computational Complexity
Statistical Mechanics
Social and Information Netwo...
Probability
Physics and Society

Community detection in graphs is the problem of finding groups of vertices which are more densely connected than they are to the rest of the graph. This problem has a long history, but it is undergoing a resurgence of interest due to the need to analyze social and biological networks. While there are many ways to formalize it, one of the most popular is as an inference problem, where there is a "ground truth" community structure built into the graph somehow. The task is then ...

Find SimilarView on arXiv

Detecting Network Communities: a new systematic and efficient algorithm

April 27, 2004

92% Match
Luca Donetti, Miguel A. Munoz
Statistical Mechanics
Other Condensed Matter

An efficient and relatively fast algorithm for the detection of communities in complex networks is introduced. The method exploits spectral properties of the graph Laplacian-matrix combined with hierarchical-clustering techniques, and includes a procedure to maximize the ``modularity'' of the output. Its performance is compared with that of other existing methods, as applied to different well-known instances of complex networks with a community-structure: both computer-genera...

Find SimilarView on arXiv

Spectral methods for the detection of network community structure: a comparative analysis

October 20, 2010

91% Match
Hua-Wei Shen, Xue-Qi Cheng
Physics and Society
Statistical Mechanics
Social and Information Netwo...

Spectral analysis has been successfully applied at the detection of community structure of networks, respectively being based on the adjacency matrix, the standard Laplacian matrix, the normalized Laplacian matrix, the modularity matrix, the correlation matrix and several other variants of these matrices. However, the comparison between these spectral methods is less reported. More importantly, it is still unclear which matrix is more appropriate for the detection of communit...

Find SimilarView on arXiv

Community detection in graphs

June 3, 2009

91% Match
Santo Fortunato
physics.soc-ph
cond-mat.stat-mech
cs.IR
physics.bio-ph
physics.comp-ph
q-bio.QM

The modern science of networks has brought significant advances to our understanding of complex systems. One of the most relevant features of graphs representing real systems is community structure, or clustering, i. e. the organization of vertices in clusters, with many edges joining vertices of the same cluster and comparatively few edges joining vertices of different clusters. Such clusters, or communities, can be considered as fairly independent compartments of a graph, p...

Find SimilarView on arXiv