ID: 1307.2104

Enhanced reconstruction of weighted networks from strengths and degrees

July 8, 2013

View on ArXiv
Rossana Mastrandrea, Tiziano Squartini, Giorgio Fagiolo, Diego Garlaschelli
Physics
Computer Science
Data Analysis, Statistics an...
Social and Information Netwo...
Physics and Society

Network topology plays a key role in many phenomena, from the spreading of diseases to that of financial crises. Whenever the whole structure of a network is unknown, one must resort to reconstruction methods that identify the least biased ensemble of networks consistent with the partial information available. A challenging case, frequently encountered due to privacy issues in the analysis of interbank flows and Big Data, is when there is only local (node-specific) aggregate information available. For binary networks, the relevant ensemble is one where the degree (number of links) of each node is constrained to its observed value. However, for weighted networks the problem is much more complicated. While the naive approach prescribes to constrain the strengths (total link weights) of all nodes, recent counter-intuitive results suggest that in weighted networks the degrees are often more informative than the strengths. This implies that the reconstruction of weighted networks would be significantly enhanced by the specification of both strengths and degrees, a computationally hard and bias-prone procedure. Here we solve this problem by introducing an analytical and unbiased maximum-entropy method that works in the shortest possible time and does not require the explicit generation of reconstructed samples. We consider several real-world examples and show that, while the strengths alone give poor results, the additional knowledge of the degrees yields accurately reconstructed networks. Information-theoretic criteria rigorously confirm that the degree sequence, as soon as it is non-trivial, is irreducible to the strength sequence. Our results have strong implications for the analysis of motifs and communities and whenever the reconstructed ensemble is required as a null model to detect higher-order patterns.

Similar papers 1

Estimating topological properties of weighted networks from limited information

September 22, 2014

92% Match
Giulio Cimini, Tiziano Squartini, ... , Garlaschelli Diego
Physics and Society
Statistical Mechanics
Social and Information Netwo...
Statistical Finance

A fundamental problem in studying and modeling economic and financial systems is represented by privacy issues, which put severe limitations on the amount of accessible information. Here we introduce a novel, highly nontrivial method to reconstruct the structural properties of complex weighted networks of this kind using only partial information: the total number of nodes and links, and the values of the strength for all nodes. The latter are used as fitness to estimate the u...

Find SimilarView on arXiv

Network reconstruction via density sampling

October 18, 2016

92% Match
Tiziano Squartini, Giulio Cimini, ... , Garlaschelli Diego
Physics and Society
Social and Information Netwo...
General Finance

Reconstructing weighted networks from partial information is necessary in many important circumstances, e.g. for a correct estimation of systemic risk. It has been shown that, in order to achieve an accurate reconstruction, it is crucial to reliably replicate the empirical degree sequence, which is however unknown in many realistic situations. More recently, it has been found that the knowledge of the degree sequence can be replaced by the knowledge of the strength sequence, ...

Find SimilarView on arXiv

A faster horse on a safer trail: generalized inference for the efficient reconstruction of weighted networks

November 24, 2018

91% Match
Federica Parisi, Tiziano Squartini, Diego Garlaschelli
Physics and Society

Due to the interconnectedness of financial entities, estimating certain key properties of a complex financial system (e.g. the implied level of systemic risk) requires detailed information about the structure of the underlying network. However, since data about financial linkages are typically subject to confidentiality, network reconstruction techniques become necessary to infer both the presence of connections and their intensity. Recently, several "horse races" have been c...

Find SimilarView on arXiv

Systemic risk analysis in reconstructed economic and financial networks

November 27, 2014

91% Match
Giulio Cimini, Tiziano Squartini, ... , Gabrielli Andrea
Physics and Society
Social and Information Netwo...
Data Analysis, Statistics an...
Statistical Finance

We address a fundamental problem that is systematically encountered when modeling complex systems: the limitedness of the information available. In the case of economic and financial networks, privacy issues severely limit the information that can be accessed and, as a consequence, the possibility of correctly estimating the resilience of these systems to events such as financial shocks, crises and cascade failures. Here we present an innovative method to reconstruct the stru...

Find SimilarView on arXiv

Reconstruction methods for networks: the case of economic and financial systems

June 18, 2018

90% Match
Tiziano Squartini, Guido Caldarelli, Giulio Cimini, ... , Garlaschelli Diego
Physics and Society
Applied Physics
Data Analysis, Statistics an...
General Finance

When studying social, economic and biological systems, one has often access to only limited information about the structure of the underlying networks. An example of paramount importance is provided by financial systems: information on the interconnections between financial institutions is privacy-protected, dramatically reducing the possibility of correctly estimating crucial systemic properties such as the resilience to the propagation of shocks. The need to compensate for ...

Find SimilarView on arXiv

Unbiased sampling of network ensembles

June 4, 2014

89% Match
Tiziano Squartini, Rossana Mastrandrea, Diego Garlaschelli
Methodology
Social and Information Netwo...
Physics and Society

Sampling random graphs with given properties is a key step in the analysis of networks, as random ensembles represent basic null models required to identify patterns such as communities and motifs. An important requirement is that the sampling process is unbiased and efficient. The main approaches are microcanonical, i.e. they sample graphs that match the enforced constraints exactly. Unfortunately, when applied to strongly heterogeneous networks (like most real-world example...

Find SimilarView on arXiv

The role of adjacency matrix degeneration in maximum entropy weighted network models

September 4, 2015

89% Match
Oleguer Sagarra, Conrad J. Pérez Vicente, Albert Díaz-Guilera
Physics and Society
Data Analysis, Statistics an...

Complex network null models based on entropy maximization are becoming a powerful tool to characterize and analyze data from real systems. However, it is not easy to extract good and unbiased information from these models: A proper understanding of the nature of the underlying events represented in them is crucial. In this paper we emphasize this fact stressing how an accurate counting of configurations compatible with given constraints is fundamental to build good null model...

Find SimilarView on arXiv

Analytical approach to network inference: Investigating degree distribution

July 17, 2018

89% Match
Gloria Cecchini, Bjoern Schelter
Data Analysis, Statistics an...
Probability
Applications

When the network is reconstructed, two types of errors can occur: false positive and false negative errors about the presence or absence of links. In this paper, the influence of these two errors on the vertex degree distribution is analytically analysed. Moreover, an analytic formula of the density of the biased vertex degree distribution is found. In the inverse problem, we find a reliable procedure to reconstruct analytically the density of the vertex degree distribution o...

Find SimilarView on arXiv

Reconstruction of financial network for robust estimation of systemic risk

September 28, 2011

88% Match
Iacopo Mastromatteo, Elia Zarinelli, Matteo Marsili
Risk Management
Disordered Systems and Neura...

In this paper we estimate the propagation of liquidity shocks through interbank markets when the information about the underlying credit network is incomplete. We show that techniques such as Maximum Entropy currently used to reconstruct credit networks severely underestimate the risk of contagion by assuming a trivial (fully connected) topology, a type of network structure which can be very different from the one empirically observed. We propose an efficient message-passing ...

Find SimilarView on arXiv

In Search of Lost Edges: A Case Study on Reconstructing Financial Networks

September 3, 2019

88% Match
Michael Lebacher, Samantha Cook, ... , Kauermann Göran
Applications

To capture the systemic complexity of international financial systems, network data is an important prerequisite. However, dyadic data is often not available, raising the need for methods that allow for reconstructing networks based on limited information. In this paper, we are reviewing different methods that are designed for the estimation of matrices from their marginals and potentially exogenous information. This includes a general discussion of the available methodology ...

Find SimilarView on arXiv