How to Compute Loop Corrections to Bethe Approximation

We propose an approach for approximating the partition function which is based on two steps: (1) computing the partition function of a simplified model which is obtained by deleting model edges, and (2) rectifying the result by applying an edge-by-edge correction. The approach leads to an intuitive framework in which one can trade-off the quality of an approximation with the complexity of computing it. It also includes the Bethe free energy approximation as a degenerate case....

In statistical physics, one of the standard methods to study second order phase transitions is the renormalization group that usually leads to an expansion around the corresponding fully connected solution. Unfortunately, often in disordered models, some important finite dimensional second-order phase transitions are qualitatively different or absent in the corresponding fully connected model: in such cases the standard expansion fails. Recently, a new method, the $M$-layer o...

The statistical mechanics method is developed for determination of generating function of like-sign spin clusters' size distribution in Ising model as modification of Ising-Potts model by K. K. Murata (1979). It is applied to the ferromagnetic Ising model on Bethe lattice. The analytical results for the field-temperature percolation phase diagram of + spin clusters and their size distribution are obtained. The last appears to be proportional to that of the classical non-corre...

In an extremely influential paper Mezard and Parisi put forward an analytic but non-rigorous approach called the cavity method for studying spin systems on the Bethe lattice, i.e., the random $d$-regular graph [Eur. Phys. J. B 20 (2001) 217--233]. Their technique was based on certain hypotheses; most importantly, that the phase space decomposes into a number of Bethe states that are free from long-range correlations and whose marginals are given by a recurrence called Belief ...

For every physical model defined on a generic graph or factor graph, the Bethe $M$-layer construction allows building a different model for which the Bethe approximation is exact in the large $M$ limit and it coincides with the original model for $M=1$. The $1/M$ perturbative series is then expressed by a diagrammatic loop expansion in terms of so-called fat-diagrams. Our motivation is to study some important second-order phase transitions that do exist on the Bethe lattice b...

We develop a transfer matrix method to compute exactly the spin-spin correlation functions of Bethe lattice spin models in the external magnetic field h and for any temperature T. We first compute the correlation function for the most general spin - S Ising model, which contains all possible single-ion and nearest-neighbor pair interactions. This general spin - S Ising model includes the spin-1/2 simple Ising model and the Blume-Emery-Griffiths (BEG) model as special cases. F...

Considering a discrete and finite statistical model of a general position we introduce an exact expression for the partition function in terms of a finite series. The leading term in the series is the Bethe-Peierls (Belief Propagation)-BP contribution, the rest are expressed as loop-contributions on the factor graph and calculated directly using the BP solution. The series unveils a small parameter that often makes the BP approximation so successful. Applications of the loop ...

We consider the equilibrium dynamics of Ising spin models with multi-spin interactions on sparse random graphs (Bethe lattices). Such models undergo a mean field glass transition upon increasing the graph connectivity or lowering the temperature. Focusing on the low temperature limit, we identify the large scale rearrangements responsible for the dynamical slowing-down near the transition. We are able to characterize exactly the dynamics near criticality by analyzing the stat...

Belief propagation (BP) is a message-passing method for solving probabilistic graphical models. It is very successful in treating disordered models (such as spin glasses) on random graphs. On the other hand, finite-dimensional lattice models have an abundant number of short loops, and the BP method is still far from being satisfactory in treating the complicated loop-induced correlations in these systems. Here we propose a loop-corrected BP method to take into account the eff...

Bethe lattice spins glasses are supposed to be marginally stable, i.e. their equilibrium probability distribution changes discontinuously when we add an external perturbation. So far the problem of a spin glass on a Bethe lattice has been studied only using an approximation where marginally stability is not present, which is wrong in the spin glass phase. Because of some technical difficulties, attempts at deriving a marginally stable solution have been confined to some pertu...