Consistency of the LSE in Linear regression with stationary noise
Volume 100 / 2004
Abstract
We obtain conditions for $L_2$ and strong consistency of the least square estimators of the coefficients in a multi-linear regression model with a stationary random noise. For given non-random regressors, we obtain conditions which ensure $L_2$-consistency for all wide sense stationary noise sequences with spectral measure in a given class. The condition for the class of all noises with continuous (i.e., atomless) spectral measures yields also $L_p$-consistency when the noise is strict sense stationary with continuous spectrum and finite absolute $p$th moment, $p\geq 1$ (even without finite variance).
When the spectral measure of the noise is not continuous, we assume that the non-random regressors are Hartman almost periodic, and obtain a spectral condition for $L_2$-consistency. An additional assumption on the regressors yields strong consistency for strictly stationary noise sequences.
We also treat the case when the regressors are random sequences, with trends having some good averaging properties and with additive stationary ergodic random fluctuations independent of the noise. When the noise and the fluctuations have disjoint point spectra and the noise is strict sense stationary, we obtain strong consistency of the LSE.
The results are applied to amplitude estimation in sums of harmonic signals with known frequencies.
