July 19, 2003
It is often necessary to compare the power spectra of two or more time series: one may, for instance, wish to estimate what the power spectrum of the combined data sets might have been, or one may wish to estimate the significance of a particular peak that shows up in two or more power spectra. Also, one may occasionally need to search for a complex of peaks in a single power spectrum, such as a fundamental and one or more harmonics, or a fundamental plus sidebands, etc. Visual inspection can be revealing, but it can also be misleading. This leads one to look for one or more ways of forming statistics, which readily lend themselves to significance estimation, from two or more power spectra. The familiar chi-square statistic provides a convenient mechanism for combining variables drawn from normal distributions, and one may generalize the chi-square statistic to be any function of any number of variables with arbitrary distributions. In dealing with power spectra, we are interested mainly in exponential distributions. One well-known statistic, formed from the sum of two or more variables with exponential distributions, satisfies the gamma distribution. We show that a transformation of this statistic has the convenient property that it has an exponential distribution. We introduce two additional statistics formed from two or more variables with exponential distributions. For certain investigations, we may wish to study the minimum power (as a function of frequency) drawn from two or more power spectra. In other investigations, it may be helpful to study the product of the powers. We give numerical examples and an example drawn from our solar-neutrino research.
Similar papers 1
February 2, 2005
In solar physics, especially in exploratory stages of research, it is often necessary to compare the power spectra of two or more time series. One may, for instance, wish to estimate what the power spectrum of the combined data sets might have been, or one may wish to estimate the significance of a particular peak that shows up in two or more power spectra. One may also on occasion need to search for a complex of peaks in a single power spectrum, such as a fundamental and one...
April 8, 2003
It is often necessary to compare the power spectra of two or more time series. One may, for instance, wish to estimate what the power spectrum of the combined data sets might have been. One might also wish to estimate the significance of a particular peak that shows up in two or more power spectra. Visual comparison can be revealing, but it can also be misleading. This leads one to look for one or more ways of forming statistics, which lend themselves to significance estimati...
September 1, 2008
The usual procedure for estimating the significance of a peak in a power spectrum is to calculate the probability of obtaining that value or a larger value by chance, on the assumption that the time series contains only noise (e.g. that the measurements were derived from random samplings of a Gaussian distribution). However, it is known that one should regard this P-Value approach with caution. As an alternative, we here examine a Bayesian approach to estimating the significa...
April 10, 2009
The usual procedure for estimating the significance of a peak in a power spectrum is to calculate the probability of obtaining that value or a larger value by chance (known as the "p-value"), on the assumption that the time series contains only noise - typically that the measurements are derived from random samplings of a Gaussian distribution. We really need to know the probability that the time series is - or is not - compatible with the null hypothesis that the measurement...
February 28, 2022
This article addresses the measurement of the power spectrum of red noise processes at the lowest frequencies, where the minimum acquisition time is so long that it is impossible to average on a sequence of data record. Therefore, averaging is possible only on simultaneous observation of multiple instruments. This is the case of radio astronomy, which we take as the paradigm, but examples may be found in other fields such as climatology and geodesy. We compare the Bayesian co...
June 3, 2010
The term "false-alarm probability" denotes the probability that at least one out of M independent power values in a prescribed search band of a power spectrum computed from a white-noise time series is expected to be as large as or larger than a given value. The usual formula is based on the assumption that powers are distributed exponentially, as one expects for power measurements of normally distributed random noise. However, in practice one typically examines peaks in an o...
August 29, 2013
We consider the "multi-frequency" periodogram, in which the putative signal is modelled as a sum of two or more sinusoidal harmonics with idependent frequencies. It is useful in the cases when the data may contain several periodic components, especially when their interaction with each other and with the data sampling patterns might produce misleading results. Although the multi-frequency statistic itself was already constructed, e.g. by G. Foster in his CLEANest algorithm,...
March 5, 1999
Applying the standard weighted mean formula, [sum_i {n_i sigma^{-2}_i}] / [sum_i {sigma^{-2}_i}], to determine the weighted mean of data, n_i, drawn from a Poisson distribution, will, on average, underestimate the true mean by ~1 for all true mean values larger than ~3 when the common assumption is made that the error of the ith observation is sigma_i = max(sqrt{n_i},1). This small, but statistically significant offset, explains the long-known observation that chi-square mini...
February 5, 2025
Compound Poisson distributions have been employed by many authors to fit experimental data, typically via the method of moments or maximum likelihood estimation. We propose a new technique and apply it to several sets of published data. It yields better fits than those obtained by the original authors for a set of widely employed compound Poisson distributions (in some cases, significantly better). The technique employs the power spectrum (the absolute square of the character...
May 6, 2020
This paper is an extension of the work about the exponential increase of the power of two non-parametric tests: the $ Z $-test and the chi-square goodness-of-fit test. Subject to having auxiliary information, it is possible to improve exponentially relative to the size of the sample the power of the famous chi-square tests of independence and homogeneity. Improving the power of these statistical tests by using auxiliary information makes it possible either to reduce the proba...