ID: astro-ph/0307353

Statistics of the Chi-Square Type, with Application to the Analysis of Multiple Time-Series Power Spectra

July 19, 2003

View on ArXiv
P. A. Sturrock, M. S. Wheatland
Astrophysics

It is often necessary to compare the power spectra of two or more time series: one may, for instance, wish to estimate what the power spectrum of the combined data sets might have been, or one may wish to estimate the significance of a particular peak that shows up in two or more power spectra. Also, one may occasionally need to search for a complex of peaks in a single power spectrum, such as a fundamental and one or more harmonics, or a fundamental plus sidebands, etc. Visual inspection can be revealing, but it can also be misleading. This leads one to look for one or more ways of forming statistics, which readily lend themselves to significance estimation, from two or more power spectra. The familiar chi-square statistic provides a convenient mechanism for combining variables drawn from normal distributions, and one may generalize the chi-square statistic to be any function of any number of variables with arbitrary distributions. In dealing with power spectra, we are interested mainly in exponential distributions. One well-known statistic, formed from the sum of two or more variables with exponential distributions, satisfies the gamma distribution. We show that a transformation of this statistic has the convenient property that it has an exponential distribution. We introduce two additional statistics formed from two or more variables with exponential distributions. For certain investigations, we may wish to study the minimum power (as a function of frequency) drawn from two or more power spectra. In other investigations, it may be helpful to study the product of the powers. We give numerical examples and an example drawn from our solar-neutrino research.

Similar papers 1

Combined and Comparative Analysis of Power Spectra

February 2, 2005

93% Match
P. A. Sturrock, J. D. Scargle, ... , Wheatland M. S.
Astrophysics

In solar physics, especially in exploratory stages of research, it is often necessary to compare the power spectra of two or more time series. One may, for instance, wish to estimate what the power spectrum of the combined data sets might have been, or one may wish to estimate the significance of a particular peak that shows up in two or more power spectra. One may also on occasion need to search for a complex of peaks in a single power spectrum, such as a fundamental and one...

Find SimilarView on arXiv

Combined and Comparative Time-Series Spectrum Analysis

April 8, 2003

89% Match
P. A. Sturrock
Astrophysics

It is often necessary to compare the power spectra of two or more time series. One may, for instance, wish to estimate what the power spectrum of the combined data sets might have been. One might also wish to estimate the significance of a particular peak that shows up in two or more power spectra. Visual comparison can be revealing, but it can also be misleading. This leads one to look for one or more ways of forming statistics, which lend themselves to significance estimati...

Find SimilarView on arXiv

A Bayesian approach to power-spectrum significance estimation, with application to solar neutrino data

September 1, 2008

86% Match
P. A. Sturrock
Astrophysics
General Relativity and Quant...
High Energy Physics - Phenom...

The usual procedure for estimating the significance of a peak in a power spectrum is to calculate the probability of obtaining that value or a larger value by chance, on the assumption that the time series contains only noise (e.g. that the measurements were derived from random samplings of a Gaussian distribution). However, it is known that one should regard this P-Value approach with caution. As an alternative, we here examine a Bayesian approach to estimating the significa...

Find SimilarView on arXiv

A Bayesian Assessment of P-Values for Significance Estimation of Power Spectra and an Alternative Procedure, with Application to Solar Neutrino Data

April 10, 2009

86% Match
P. A. Sturrock, J. D. Scargle
High Energy Astrophysical Ph...
Instrumentation and Methods ...

The usual procedure for estimating the significance of a peak in a power spectrum is to calculate the probability of obtaining that value or a larger value by chance (known as the "p-value"), on the assumption that the time series contains only noise - typically that the measurements are derived from random samplings of a Gaussian distribution. We really need to know the probability that the time series is - or is not - compatible with the null hypothesis that the measurement...

Find SimilarView on arXiv

The Statistics of the Cross-Spectrum and the Spectrum Average: Generalization to Multiple Instruments

February 28, 2022

85% Match
Antoine Baudiquez, Éric Lantz, ... , Vernotte François
Data Analysis, Statistics an...

This article addresses the measurement of the power spectrum of red noise processes at the lowest frequencies, where the minimum acquisition time is so long that it is impossible to average on a sequence of data record. Therefore, averaging is possible only on simultaneous observation of multiple instruments. This is the case of radio astronomy, which we take as the paradigm, but examples may be found in other fields such as climatology and geodesy. We compare the Bayesian co...

Find SimilarView on arXiv

False-alarm probability in relation to over-sampled power spectra, with application to Super-Kamiokande solar neutrino data

June 3, 2010

84% Match
Peter A. Sturrock, Jeffrey D. Scargle
Instrumentation and Methods ...
Data Analysis, Statistics an...

The term "false-alarm probability" denotes the probability that at least one out of M independent power values in a prescribed search band of a power spectrum computed from a white-noise time series is expected to be as large as or larger than a given value. The usual formula is based on the assumption that powers are distributed exponentially, as one expects for power measurements of normally distributed random noise. However, in practice one typically examines peaks in an o...

Find SimilarView on arXiv

Detecting multiple periodicities in observational data with the multi-frequency periodogram. I. Analytic assessment of the statistical significance

August 29, 2013

84% Match
Roman V. Baluev
Instrumentation and Methods ...

We consider the "multi-frequency" periodogram, in which the putative signal is modelled as a sum of two or more sinusoidal harmonics with idependent frequencies. It is useful in the cases when the data may contain several periodic components, especially when their interaction with each other and with the data sampling patterns might produce misleading results. Although the multi-frequency statistic itself was already constructed, e.g. by G. Foster in his CLEANest algorithm,...

Find SimilarView on arXiv

Parameter Estimation in Astronomy with Poisson-Distributed Data. I. The Chi-Square-Gamma Statistic

March 5, 1999

84% Match
Kenneth J. National Optical Astronomy Observatories Mighell
Astrophysics

Applying the standard weighted mean formula, [sum_i {n_i sigma^{-2}_i}] / [sum_i {sigma^{-2}_i}], to determine the weighted mean of data, n_i, drawn from a Poisson distribution, will, on average, underestimate the true mean by ~1 for all true mean values larger than ~3 when the common assumption is made that the error of the ith observation is sigma_i = max(sqrt{n_i},1). This small, but statistically significant offset, explains the long-known observation that chi-square mini...

Find SimilarView on arXiv

New technique for parameter estimation and improved fits to experimental data for a set of compound Poisson distributions

February 5, 2025

83% Match
S. R. Mane
Methodology
Probability

Compound Poisson distributions have been employed by many authors to fit experimental data, typically via the method of moments or maximum likelihood estimation. We propose a new technique and apply it to several sets of published data. It yields better fits than those obtained by the original authors for a set of widely employed compound Poisson distributions (in some cases, significantly better). The technique employs the power spectrum (the absolute square of the character...

Find SimilarView on arXiv

Exponential increase of the power of the independence and homogeneity chi-square tests with auxiliary information

May 6, 2020

82% Match
Mickael Albertus
Statistics Theory
Applications
Computation
Methodology
Statistics Theory

This paper is an extension of the work about the exponential increase of the power of two non-parametric tests: the $ Z $-test and the chi-square goodness-of-fit test. Subject to having auxiliary information, it is possible to improve exponentially relative to the size of the sample the power of the famous chi-square tests of independence and homogeneity. Improving the power of these statistical tests by using auxiliary information makes it possible either to reduce the proba...

Find SimilarView on arXiv