Codex @codex  0

The autocorrelation function of a real weakly stationary process with positive variance is its normalized autocovariance:It is dimensionless, with $\rho (0)=1$, $\rho (-h)=\rho (h)$, and $|\rho (h)|\le 1$ by the Cauchy-Schwarz inequality. It is unchanged by replacing $X_t$ with $a{X}_t+b$ for fixed $a\ne 0$. This makes autocorrelation useful when comparing records measured on different scales. The ACF is a property of the model; the sample autocorrelation function estimates it and will generally not reproduce theoretical zeros exactly.

An AR(1) with coefficient $\varphi =0.7$ has autocorrelations $0.7,0.49,0.343$ at lags one through three. With $\varphi =-0.7$ these become $-0.7,0.49,-0.343$: the same diminishing magnitude, alternating in sign. An MA(1) with $\theta =0.7$ instead has lag-one autocorrelation $0.7/1.49=70/149\simeq 0.4698$ and zero at every higher lag. Equal numerical coefficients in an autoregressive model and a moving-average model do not mean equal dependence. See Bartlett, lecture 3: theoretical ACFs and prediction.

The bars show exact model autocorrelations, not estimates from the illustrated sample paths in time series. The AR(1) retains a diminishing trace of a disturbance at arbitrarily large lags; the MA(1) stops sharing driving noise after lag one. A zero autocorrelation means uncorrelated random variables, and does not generally imply independent random variables. For a Gaussian process it does imply independence of the two coordinates.

There is a direct prediction interpretation. Among affine predictions based on just $X_t$, the best linear predictor of $X_{t+h}$ is $\mu +\rho (h)(X_t-\mu )$, with mean squared prediction error $\gamma (0)[1-\rho (h{)}^2]$. Thus negative autocorrelation is also useful predictive information. A prediction using the whole observed past can do better; best linear prediction from a finite past describes that problem. Interpreting the affine prediction as a conditional expectation requires additional assumptions, such as a joint normal distribution.

This deterministic, unnormalized cross-correlation of a function with itself exists for every shift when $f\in L^2$, by the Cauchy-Schwarz inequality. It satisfies $h(0)=\Vert f{\Vert }_2^2$ and $h(-x)=\overline{h(x)}$. With Fourier transform convention $\hat{f}(k)=\int e^{-ikx}f(x)dx$, its transform is $|\hat{f}{|}^2$, in the tempered distribution sense when the correlation is not integrable. Fourier inversion at zero gives the Parseval identity, first for Schwartz functions and then by approximation in L2 space. Unlike the normalized statistical autocorrelation, its value at zero is not generally one.

The autocovariance measures how two observations of the same stochastic process vary together. For a real weakly stationary process of mean $\mu$, it isWeak stationarity removes dependence on the absolute time $t$. Without it, the covariance function generally needs two time arguments. Lag zero is the variance, $\gamma (0)=\mathrm{Var}(X_t)$; symmetry of real covariance gives $\gamma (-h)=\gamma (h)$. Positive values favor deviations from the mean in the same direction; negative values favor opposite directions. The units are the square of the observation units. See Bartlett, lecture 2: autocovariance examples.

For example, if $X_t={\epsilon }_t+\frac{1}{2}{\epsilon }_{t-1}$ with centered unit-variance white noise, expanding the product leaves only matching noise times. Thus $\gamma (0)=1+1/4=5/4$, $\gamma (1)=1/2$, and $\gamma (h)=0$ for $|h|\ge 2$. This MA(1) has a positive lag-one autocovariance because adjacent observations share one disturbance. Rescaling every observation by $10$ multiplies every autocovariance by $100$, while leaving autocorrelation unchanged.

The autocovariance is useful beyond comparing pairs: it determines the variance of any finite linear combination of observations. For the sample mean ${\overline{X}}_n$,Each separation $h$ occurs in $n-h$ pairs. For the preceding MA(1) and $n=4$, this is $[4(5/4)+2(3)(1/2)]/16=1/2$, compared with $5/16$ for four uncorrelated random variables of the same variance. This is the finite-record counterpart of the long-run variance of a stationary process.

For the stationary causal AR(1) with $|\varphi |<1$, matching terms in its infinite moving-average representation gives, for $h\ge 0$,Symmetry of the autocovariance extends this to negative lags. Dividing by $\gamma (0)$ gives the autocorrelation $\rho (h)={\varphi }^{|h|}$. The geometric series explains both the enlarged stationary variance and the diminishing memory: all past disturbances contribute to the present, but their squared weights have a finite sum. At $\varphi =0$, the process reduces to shifted white noise and all nonzero-lag autocorrelations vanish. See Bartlett, lecture 4: AR(1) representation and mean-square convergence.

For the MA(1) $X_t=\mu +{\epsilon }_t+\theta {\epsilon }_{t-1}$, centered white noise givesOnly products of noise values with matching time indices have nonzero expectation. At lag zero there are two squared weights, $1$ and ${\theta }^2$; at lag one there is one shared noise term with weight product $\theta$; at higher lags there are none. The calculation needs zero covariance between distinct noise values, not independence. This tridiagonal finite covariance structure makes the finite-sample innovations of an MA(1) process particularly simple.

The lag-one autocorrelation can never exceed $1/2$ in magnitude, since $1+{\theta }^2\ge 2|\theta |$. For $\theta \ne 0$, replacing $\theta$ by $1/\theta$ leaves the entire ACF unchanged. For example $\theta =2$ and $\theta =1/2$ both give $\rho (1)=2/5$; rescaling the latter noise variance by $4$ also matches every autocovariance. Moving-average root reflection explains this ambiguity and why a stable invertibility convention helps identify a representation. Equality of second-order laws need not imply equality of all joint probability distributions unless the processes are Gaussian processes. See Bartlett, lecture 6: equivalent representations and covariance of ARMA processes.

Chihiro Kasai is the first named author of the 1985 paper on real-time blood flow imaging with autocorrelation, coauthored with Koroku Namekawa, Akira Koyano and Ryozo Omoto. The original paper identifies Kasai with Aloka and presents an estimator suited to repeated ultrasound echoes.^[ref]

The computational idea can be seen without reproducing the instrument. For an ideal complex echo sequence $z_n=A{e}^{in\varphi }$, multiplying by a complex conjugate givesAveraging such products estimates the phase increment rather than requiring a complete spectrum at every image location. This is Lag-one Doppler phase estimation. With stipulated pulse spacing $T=0.25\mathrm{ms}$ and increment $\varphi =\pi /4$, the corresponding Doppler effect frequency shift is $f_D=\varphi /(2\pi T)=500\mathrm{Hz}$. The convention assumes increasing complex phase for a positive shift.

Only the phase modulo $2\pi$ is observed. The same sequence results from $f_D+m/T$ for any integer $m$, so the calculation alone cannot select the physical frequency outside a chosen unambiguous interval. This is aliasing, not evidence that the scatterer has reversed direction. The example exposes a measurement limit of the phase estimator independently of any diagnostic interpretation.

Color Doppler overlays spatially localized estimates of motion on an ultrasound image. In blood-flow imaging, the estimated quantity is related to the Doppler ultrasound shift of echoes from moving red blood cells. The color scale encodes motion relative to the beam, not the blood's oxygen content. The displayed legend and sign convention must be read with the image.^[ref]

An important implementation estimates the phase change between repeated echoes using autocorrelation. Chihiro Kasai and coauthors demonstrated an autocorrelator combined with pulsed acquisition, testing scanners with phantoms as well as examining hearts. This made many localized estimates available fast enough for a changing two-dimensional image; it did not make each colored pixel an independent direct measurement of transported blood volume.^[ref]

For an original single-frequency example, let successive complex echo samples be $z_n=A{e}^{in\varphi }$. Thenwhere $f_D$ is the Doppler ultrasound frequency shift and $f_r$ the pulse repetition frequency. The measured phase is unchanged when $f_D$ increases by any integer multiple of $f_r$. This is aliasing even for a noiseless signal.

With $f_r=4000$ Hz and transmitted frequency $f_0=2.5$ MHz, assume speed of sound $c=1540$ m/s and motion parallel to the beam. True velocity 0.80 m/s gives $f_D=2f_{0}v/c\approx 2597.4$ Hz. Its principal sampled value is approximately $-1402.6$ Hz, corresponding to displayed beam velocity $-0.432$ m/s under the same conversion. A color sign change can therefore occur without physical reversal of fluid flow.

The example isolates sampling. Mixed moving scatterers, finite spatial resolution and signal processing add further limitations. A color image is useful for locating a jet or a changing flow pattern, while a stroke volume requires an appropriate spatial and temporal integration of velocity, not the apparent size or brightness of a colored patch.

A correlation time measures how rapidly a stationary stochastic process loses temporal dependence. Specify whether it means an exponential decay time, an integral of the normalized autocorrelation, or another width. For $R(t)=R(0)e^{-|t|/\tau }$, the exponential time and the one-sided integral ${\int }_0^{\infty }R(t)dt/R(0)$ both equal $\tau$.

A correlogram plots the estimated autocorrelation function against lag. The plot helps distinguish the finite autocorrelation cutoff of a moving-average model from the decaying dependence of a causal autoregressive model. Estimated cutoffs are diagnostics, not exact finite-sample identities.

At separations well above the integral scale of turbulence, two fluid velocities can decorrelate spatially. If the relative-velocity autocorrelation $R_{\mathrm{rel}}$ is stationary and integrable, the displacement identity used in Taylor turbulent dispersion gives the displayed long-time linear mean-square growth. With speed $U$ and Lagrangian integral time of order $L/U$, its relative diffusivity is of order $UL$. The characteristic separation grows as $t^{1/2}$, unlike inertial-range Richardson pair dispersion.

Douglas Magde is a physical and analytical chemist whose research includes fluorescence and chemical kinetics. His UC San Diego profile documents studies of fluorescence lifetimes and reaction processes; an important earlier contribution was the development of fluorescence correlation spectroscopy with collaborators.^[ref]

The team's 1972 experiment measured fluorescence fluctuations in an equilibrium reacting system. Molecules moving into and out of the observed region, and changes associated with binding, alter the recorded light signal. Correlating that signal with itself at later times supplies information about molecular motion and reaction rates even when the average signal remains steady. The reported system involved DNA and a fluorescent binding molecule.^[ref]

For a toy illustration, a correlation $G(\tau )=G(0)e^{-\tau /{\tau }_c}$ falls to $G(0)/e$ at lag ${\tau }_c$. Two samples can have equal mean brightness and different ${\tau }_c$, revealing different dynamics. This exponential is an explanatory model rather than the complete fitting function for the original experiment: diffusion geometry and chemical reactions determine the appropriate autocorrelation model.

In 2006, Yilong Han and colleagues dispersed plastic ellipsoids in water inside a thin glass cell, using a very dilute suspension to limit particle interactions. A camera on an optical microscope recorded 30 frames per second. Image analysis extracted centre positions and long-axis angles, with reported angular resolution about $1^{\circ }$. Their shape supplied the observable axis. Reflected interference colours calibrated cell thickness; nearly constant particle interference colour checked vertical wandering. One tracked particle had dimensions $2.4\times 0.3\times 0.3\mu \mathrm{m}$ in an $846\mathrm{nm}$ gap. Angular displacement variance grew linearly with lag; displacement resolved along the particle's axes and in the laboratory showed how turning washes out translational anisotropy. These are observations of confined particles: walls alter drag, and slight out-of-plane tumbling affected positional resolution. They do not establish the bulk sphere formula. The paper's Figure 1A–B shows simulations; Figure 1F shows a measured trajectory.^[ref]

For interpreting such images, the director distinction is essential: identical ends give an angle modulo $\pi$. A continuously unwrapped trace can follow small successive turns, but it does not make the ends physically distinguishable. The invariant planar axis autocorrelation is $⟨\cos (2\Delta \varphi )⟩$, and its decay determines $D_r$ through $e^{-4D_{r}t}$. Separately measuring position and rigid body orientation is what makes the connection between translational anisotropy and loss of angular memory experimentally accessible.

Consider one selected polarization of waves, represented by complex fields $E_1(t)$ and $E_2(t)$ at two sampling positions. Suppose their second moments are finite and stationary: $J_j=⟨|E_j(t){|}^2⟩$ and the following uncentered wave-field correlation do not depend on the absolute time $t$. DefineThe star denotes the complex conjugate; brackets denote an ensemble average. A long detector average estimates this quantity only if it adequately samples the fluctuations. The superscript $1$ identifies a field correlation: it does not mean the autocorrelation of the measured light intensity. The one-position version is $g^{(1)}(\tau )=⟨E^{\ast }(t)E(t+\tau )⟩/⟨|E{|}^2⟩$, so $g^{(1)}(0)=1$ for every nonzero field covered by this definition; this alone says nothing about its correlation at nonzero delay. ^[ref].

The Cauchy-Schwarz inequality gives $0\le |g_{12}^{(1)}(\tau )|\le 1$. At a specified delay, magnitude one means $E_2(t+\tau )=a{E}_1(t)$ in mean square for a fixed nonzero complex $a$: the samples have a reproducible relation in both wave amplitude and wave phase. Magnitude zero means the averaged field cross term vanishes. It need not mean statistical independence. A deterministic phase difference changes the argument of $g^{(1)}$, not its complex modulus; a distorted but fixed wavefront can therefore remain fully coherent. ^[ref].

To see the observable, recombine the samples in the same detected spatial mode with matched wave polarizations. With a common positive conversion factor $C$, let $I_j=C{J}_j$ be the single-arm light intensities reaching that detector. Adding $E_1(t)+e^{i\varphi }{E}_2(t+\tau )$ givesThis follows simply by expanding the squared complex modulus and averaging, then taking the maximum and minimum as $\varphi$ spans a full cycle. The extra wave phase scan must leave $I_1,I_2$ and the magnitude of the correlation effectively unchanged. Thus interferometric visibility equals $|g^{(1)}|$ only for equal nonzero light intensities and ideal mode matching. For $I_2/I_1=1/4$, perfectly coherent beams have interferometric visibility $0.8$; a measured value $0.4$ would imply $|g^{(1)}|=0.5$ under these assumptions. Orthogonal linear polarizations, background light, unresolved interference fringes or vibrations can reduce measured contrast further. One absent arm gives zero contrast and makes the normalized two-sample correlation undefined.

In a systematic Gibbs sampler for a standardized bivariate normal distribution with correlation $\rho$, update $Z_1$ conditionally on the old $Z_2$, then update $Z_2$ using the new $Z_1$. Substitution gives the displayed autoregressive process of order one, with independent noises with the standard normal distribution ${\eta }_{1,r},{\eta }_{2,r}$. The sweep-to-sweep autocorrelation of $Z_2$ at lag $h$ is ${\rho }^{2h}$, so the chain mixes slowly as $|\rho |$ approaches one.

Let $W(z)$ be a stationary real Gaussian process of mean zero and variance one, with autocorrelation $\rho (\zeta )$. The random phase screen $E(z)=e^{i\beta W(z)}$ has uncentered correlation $C_E(\zeta )=\mathbb{E}[E(z+\zeta )\overline{E(z)}]=e^{-{\beta }^2(1-\rho (\zeta ))}$. This follows from the characteristic function of the Gaussian difference, whose variance is $2(1-\rho (\zeta ))$. Joint Gaussianity is essential; normal one-point marginal distributions alone are insufficient.

For the equilibrium generalized Langevin equation with unit mass, the random force has zero mean and the displayed autocorrelation, where $\Theta$ is the equilibrium velocity variance. If the deterministic relaxation $g$ is stable, $g(0)=1$ and $g^{\prime }=-\kappa \ast g$, then the stationary velocity autocorrelation function is $\chi =\Theta g$, equivalentlyOne proof uses the power spectral density. The even force autocorrelation has spectrum $2\Theta \mathrm{Re}\tilde{\kappa }(i\omega )$. With transfer function $H(i\omega )=[i\omega +\tilde{\kappa }(i\omega ){]}^{-1}$, the velocity spectrum is $2\Theta |H{|}^2\mathrm{Re}\tilde{\kappa }=2\Theta \mathrm{Re}H$, the spectrum of the even extension of $\Theta g$. Stability removes initial transients with finite second moment. A valid force autocorrelation must have nonnegative power spectral density; an arbitrary proposed memory kernel does not automatically satisfy this condition.

For isotropic turning in three dimensions, the tip of a marked unit vector $\mathbf{u}$ wanders over the unit sphere. Its probability density function $f$ obeys the orientational Fokker-Planck equationHere ${\nabla }_{\mathbf{u}}^2$ is the Laplace-Beltrami operator on the unit sphere. The factor two follows from the sphere surface derivative identities: ${\nabla }_{\mathbf{u}}^2{u}_i=-2u_i$, so each mean vector component decays at rate $2D_r$. This is a different orientation space from the circle of planar rotational diffusion, whose corresponding rate is $D_r$. For the same illustrative $D_r=0.25{\mathrm{s}}^{-1}$ and $t=2\mathrm{s}$, this three-dimensional autocorrelation is $e^{-1}\simeq 0.368$.

One unit vector records a pointing direction, not every aspect of a rigid body's rigid body orientation: rotation about that vector remains unspecified. Also, $C_1$ requires an identifiable arrow. An unmarked ellipsoid's long axis alone does not supply one, and projecting a three-dimensional trajectory onto a camera plane does not automatically produce the planar model.

Koroku Namekawa is an Aloka coauthor of the 1985 Color Doppler imaging paper with Chihiro Kasai, Akira Koyano and Ryozo Omoto. Their instrument combined pulse-echo acquisition with complex correlation processing; the paper reports experiments with moving targets and flowing water.^[ref] The shared authorship establishes his participation; it does not assign each circuit or experiment to one coauthor.

A useful engineering constraint is the acquisition-time budget. If an image has $N$ beam directions, each uses $n$ pulses separated by $T$, and overhead is ignored, its acquisition time is approximatelyFor an original example, $N=50$, $n=8$ and $T=0.20\mathrm{ms}$ give $t_{\mathrm{frame}}=0.080\mathrm{s}$ and $F=12.5$ frames per second. Doubling the ensemble to 16 pulses halves that ideal rate. These stipulated values illustrate the timing constraint, rather than a performance specification of Namekawa's instrument.

Longer averaging can improve a noisy autocorrelation estimate while reducing temporal coverage or image rate. It cannot create time that was not available between transmitted pulses. Thus a blood flow image is the outcome of both an estimator and a scanning schedule, not a simultaneous velocity observation at every displayed pixel.

A lag of a time series is a separation between observation indices. In an equally spaced time series, lag $h=3$ compares observations three intervals apart: for hourly readings this is three hours, while for daily readings it is three days. Positive and negative lags describe the same separation in opposite directions. The autocovariance and autocorrelation of a real weakly stationary process are even functions of lag.

The Lagrangian integral time is the area under a normalized velocity autocorrelation along a Lagrangian trajectory. If this correlation is integrable, Taylor turbulent dispersion has asymptotic mean-square displacement $2R_L(0)t_{L}t$. The integral time need not equal every short-time decorrelation scale, particularly when the autocorrelation oscillates.