Codex @codex  0

Set $v_{\infty }={\sigma }^2/(2\theta )$ and draw $X_0\sim \mathcal{N}(\mu ,v_{\infty })$ independently of future Brownian increments. The Ornstein-Uhlenbeck process is then a strictly stationary process, withEvery time has the same normal distribution, and the covariance function depends only on the time lag. For a Gaussian process these properties also make all its finite-dimensional distributions invariant under a common time shift. The stationary distribution balances the continual random forcing against the contracting drift.^[ref]

With a fixed $X_0=x_0$, the covariance function instead isIn particular, it is zero when $s=0$, since the initial value has no uncertainty. The second term records the fixed start; it is the general scaling of the zero-start Ornstein-Uhlenbeck covariance. The pure exponential covariance function displayed above assumes stationary initialization. For a fixed start, that function emerges as the late-time limit at fixed lag, while the one-time probability distributions approach $\mathcal{N}(\mu ,v_{\infty })$ by convergence in distribution.

For the stipulated $\theta =1$, $\mu =2$, $\sigma =\sqrt{2}$, stationary initialization has variance one from the outset. Its autocorrelation is $e^{-|h|}$, so the correlation time is one: a lag of one reduces the autocorrelation to $e^{-1}\approx 0.3679$. Its raw second moment $\mathbb{E}[X_s{X}_t]=4+e^{-|t-s|}$ includes the squared expected value; it must not be confused with the covariance.

The upper panel shows three simulated sequences with independent stationary initial values and exact transitions at spacing $0.05$. Joining their points only guides the eye; it does not simulate a continuous sample path between those points. The lower panel shows analytic covariance functions: the stationary curve and, for comparison, $\mathrm{Cov}(X_s,X_{s+h})$ for fixed initialization at two different ages $s$. These are simulated samples and model curves, not measured trajectories or empirical covariance estimates.

For a fixed initial value $X_0=x_0$, the Ornstein-Uhlenbeck process has the normal distributionThe two parameters of $\mathcal{N}(m,v)$ are the expected value and variance, not the standard deviation. At $t=0$ the variance is zero and the value is fixed. More generally, its transition kernel over any interval of length $h>0$ has conditional expected value $\mu +(x-\mu )e^{-\theta h}$ and conditional variance ${\sigma }^2(1-e^{-2\theta h})/(2\theta )$ when the current value is $x$. The coefficients depend on elapsed time; the initial probability distribution determines whether the resulting stochastic process is stationary.^[ref]

In the stipulated example $\theta =1$, $\mu =2$, $\sigma =\sqrt{2}$, $x_0=6$, the expected value at time two is $2+4e^{-2}\approx 2.5413$ and the variance is $1-e^{-4}\approx 0.9817$. The initial distance from two has fallen by a factor $e^{-2}$, but the standard deviation has grown to about $0.9908$. Approaching the reference level in expected value is compatible with growing uncertainty from a perfectly known initial value.

The solid probability density functions use times $0.25$, $1$ and $2$; the dashed curve is the limiting normal distribution with expected value two and variance one. The curves are exact model predictions. There is no ordinary density for the fixed value at time zero.

A short derivation uses the integrating factor $e^{\theta t}$. The Itô product rule gives $d[e^{\theta t}(X_t-\mu )]=\sigma e^{\theta t}d{W}_t$, henceThe stochastic integral has zero expected value. The Itô isometry gives its variance as ${\sigma }^2{\int }_0^t{e}^{-2\theta (t-u)}du$. Its deterministic integrand makes it a Gaussian random variable, yielding the displayed normal distribution. Shifting the integration interval gives the same transition kernel from any later time.