0% found this document useful (0 votes)
288 views3 pages

Understanding Autocovariance Functions

Autocovariance is a function that gives the covariance of a stochastic process with itself at different time points. It is closely related to autocorrelation. The autocovariance of a weakly stationary stochastic process is defined as the covariance between the process at one time and the process at another time, and only depends on the lag between the two times. Autocovariance can be used to calculate turbulent diffusivity by relating the turbulent flux to velocity autocovariance using Fick's laws of diffusion.

Uploaded by

isabella343
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
288 views3 pages

Understanding Autocovariance Functions

Autocovariance is a function that gives the covariance of a stochastic process with itself at different time points. It is closely related to autocorrelation. The autocovariance of a weakly stationary stochastic process is defined as the covariance between the process at one time and the process at another time, and only depends on the lag between the two times. Autocovariance can be used to calculate turbulent diffusivity by relating the turbulent flux to velocity autocovariance using Fick's laws of diffusion.

Uploaded by

isabella343
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Autocovariance

In probability theory and statistics, given a stochastic process, the autocovariance is a function that gives the covariance of the process with itself at pairs of time
points. Autocovariance is closely related to the autocorrelation of the process in question.

Auto-covariance of stochastic processes

Definition

With the usual notation for the expectation operator, if the stochastic process has the mean function , then the autocovariance is given
by[1]: p . 162 

   

where and are two instances in time.

Definition for weakly stationary process

If is a weakly stationary (WSS) process, then the following are true:[1]: p . 163 

for all

and

for all

and

where is the lag time, or the amount of time by which the signal has been shifted.

The autocovariance function of a WSS process is therefore given by:[2]: p . 517 

 
 

   
(Eq.2)

which is equivalent to

Normalization

It is common practice in some disciplines (e.g. statistics and time series analysis) to normalize the autocovariance function to get a time-dependent Pearson
correlation coefficient. However in other disciplines (e.g. engineering) the normalization is usually dropped and the terms "autocorrelation" and "autocovariance"
are used interchangeably.

The definition of the normalized auto-correlation of a stochastic process is

If the function is well-defined, its value must lie in the range , with 1 indicating perfect correlation and −1 indicating perfect anti-correlation.

For a WSS process, the definition is

where

Properties

Symmetry property

[3]: p.169 
respectively for a WSS process:

[3]: p.173 

Linear filtering

The autocovariance of a linearly filtered process

is

Calculating turbulent diffusivity


Autocovariance can be used to calculate turbulent diffusivity.[4] Turbulence in a flow can cause the fluctuation of velocity in space and time. Thus, we are able to
identify turbulence through the statistics of those fluctuations.

Reynolds decomposition is used to define the velocity fluctuations (assume we are now working with 1D problem and is the velocity along
direction):

where is the true velocity, and is the expected value of velocity. If we choose a correct , all of the stochastic components of the
turbulent velocity will be included in . To determine , a set of velocity measurements that are assembled from points in space, moments in time or
repeated experiments is required.

If we assume the turbulent flux ( , and c is the concentration term) can be caused by a random walk, we can use Fick's laws of diffusion to
express the turbulent flux term:

The velocity autocovariance is defined as

or

where is the lag time, and is the lag distance.

The turbulent diffusivity can be calculated using the following 3 methods:

1. If we have velocity data along a Lagrangian trajectory:

2. If we have velocity data at one fixed (Eulerian) location:

3. If we have velocity information at two fixed (Eulerian) locations:

where is the distance separated by these two fixed locations.

Auto-covariance of random vectors

See also
Autoregressive process
Correlation
Cross-covariance
Cross-correlation
Noise covariance estimation (as an application example)

References
1. Hsu, Hwei (1997). Probability, random variables, and random processes ([Link] McGraw-Hill.
ISBN 978-0-07-030644-8.
2. Lapidoth, Amos (2009). A Foundation in Digital Communication. Cambridge University Press. ISBN 978-0-521-19395-5.
3. Kun Il Park, Fundamentals of Probability and Stochastic Processes with Applications to Communications, Springer, 2018, 978-3-319-68074-3
4. Taylor, G. I. (1922-01-01). "Diffusion by Continuous Movements" ([Link] (PDF). Proceedings of
the London Mathematical Society. s2-20 (1): 196–212. doi:10.1112/plms/s2-20.1.196 ([Link]
ISSN 1460-244X ([Link]

Further reading
Hoel, P. G. (1984). Mathematical Statistics (Fifth ed.). New York: Wiley. ISBN 978-0-471-89045-4.
Lecture notes on autocovariance from WHOI ([Link]
[Link])

Retrieved from "[Link]

Common questions

Powered by AI

Normalization of autocovariance to obtain the autocorrelation coefficient is often necessary in disciplines like statistics and time series analysis to ensure measurements are comparable and scaled between -1 and 1. However, in engineering disciplines, the interest may lie more in the raw covariance values themselves when analyzing signal processes, thus omitting normalization and treating autocorrelation and autocovariance interchangeably .

For a weakly stationary process, the autocovariance only depends on the time lag τ between observations, taking the form C(τ) = E[(X(t) - μ)(X(t+τ) - μ)], where μ is the mean of the process. This form simplifies analysis since the dependency on specific time points is eliminated, reducing the complexity of characterizing the process's temporal dependencies .

The autocovariance function of a linearly filtered stochastic process can indicate how the filter affects the signal's statistical properties. Specifically, for a weakly stationary input process, the output's autocovariance is derived by convolving the input's autocovariance with the filter's impulse response squared, showing how filtering modifies correlation structure but not inherent randomness .

Autocovariance is a measure of the covariance of a stochastic process with itself at different times. It is closely related to autocorrelation, which normalizes the autocovariance by dividing it by the product of the variances. Specifically, for a weakly stationary process, autocorrelation can be seen as a scaled version of autocovariance, thus expressing the degree of similarity between observations as a function of the time lag .

Reynolds decomposition separates a velocity field into mean and fluctuating components. This decomposition allows for the calculation of velocity fluctuations' statistical properties, notably through autocovariance. The velocity autocovariance quantifies how fluid parcels' velocity deviations from the mean correlate over time and space, thereby determining turbulent characteristics .

Autocovariance is used to calculate turbulent diffusivity by analyzing the fluctuations in velocity within a fluid flow. Different methods exist depending on the available data: when velocity data is available along a Lagrangian trajectory or at fixed Eulerian locations, the autocovariance of velocity differences can be used to derive turbulent diffusivity via correlations over time or space, respectively .

In Kalman filtering, estimating the noise covariance involves determining the statistical characteristics of the measurement noise, which can be aided by calculating the autocovariance of noise over observed data. By analyzing autocovariance, one can better model the noise dynamics, ensuring accurate state estimations through improved filter tuning .

For a weakly stationary process, the autocovariance function exhibits symmetry, meaning it only depends on the time difference or lag between two points, not the actual time points themselves. Consequently, the autocovariance at lag τ is equal to that at lag -τ, expressed as C(t, t+τ) = C(t+τ, t).

From a Lagrangian perspective, velocity data along a fluid particle's path is used. The autocovariance function is computed by correlating the velocities at different time lags along the trajectory. This involves calculating the expected product of velocity deviations from the mean at these lags, capturing the temporal correlation structure of the particle's dynamic path through the fluid .

Autocovariance aids in modeling turbulent flux by linking velocity fluctuations to diffusion. According to Fick's laws, diffusion is proportional to the concentration gradient. Autocovariance extends this by quantifying the temporal and spatial correlations in flow velocity, offering insights into how random motions induce mixing and diffusion akin to molecular processes, critical in expressing turbulent fluxes mathematically .

You might also like