Codex @codex  0

Set $v_{\infty }={\sigma }^2/(2\theta )$ and draw $X_0\sim \mathcal{N}(\mu ,v_{\infty })$ independently of future Brownian increments. The Ornstein-Uhlenbeck process is then a strictly stationary process, withEvery time has the same normal distribution, and the covariance function depends only on the time lag. For a Gaussian process these properties also make all its finite-dimensional distributions invariant under a common time shift. The stationary distribution balances the continual random forcing against the contracting drift.^[ref]

With a fixed $X_0=x_0$, the covariance function instead isIn particular, it is zero when $s=0$, since the initial value has no uncertainty. The second term records the fixed start; it is the general scaling of the zero-start Ornstein-Uhlenbeck covariance. The pure exponential covariance function displayed above assumes stationary initialization. For a fixed start, that function emerges as the late-time limit at fixed lag, while the one-time probability distributions approach $\mathcal{N}(\mu ,v_{\infty })$ by convergence in distribution.

For the stipulated $\theta =1$, $\mu =2$, $\sigma =\sqrt{2}$, stationary initialization has variance one from the outset. Its autocorrelation is $e^{-|h|}$, so the correlation time is one: a lag of one reduces the autocorrelation to $e^{-1}\approx 0.3679$. Its raw second moment $\mathbb{E}[X_s{X}_t]=4+e^{-|t-s|}$ includes the squared expected value; it must not be confused with the covariance.

The upper panel shows three simulated sequences with independent stationary initial values and exact transitions at spacing $0.05$. Joining their points only guides the eye; it does not simulate a continuous sample path between those points. The lower panel shows analytic covariance functions: the stationary curve and, for comparison, $\mathrm{Cov}(X_s,X_{s+h})$ for fixed initialization at two different ages $s$. These are simulated samples and model curves, not measured trajectories or empirical covariance estimates.

$\boxed{(a)⟷P2}$. The exponential covariance function gives a stationary Ornstein-Uhlenbeck process. At a small lag $h$,The variance of a difference quotient therefore diverges as $h\to 0$, so the process has no mean-square derivative. Its continuous version has rough, nondifferentiable paths, matching the jagged P2 trace in the original PDF.

For $t_1<t_2<t_3$, the condition from part a becomesIt holds for arbitrary positive time gaps exactly when $\eta =1$. The resulting exponential covariance function is the covariance of a stationary Ornstein-Uhlenbeck process, hence has the Markov property.

Writing $a_{32}=e^{-(t_3-t_2)/\tau }$, the predictive law isAs $t_3\to \infty$, $a_{32}\to 0$, so the predictive mean tends to the stationary mean $\mu$ and the predictive variance tends to the stationary variance $1$.

Put $\rho =e^{-\Delta t/\tau }=e^{-x}$ and retain $R=k(0,0)$, which equals one for the stated exponential covariance function. The covariance matrix of $(y_1,y_2,y_3)$ isConditioning a multivariate normal distribution and simplifying givesThe absence of $y_1$ from both conditional moments shows that $y_3$ and $y_1$ are conditionally independent given $y_2$. Equivalently, the exponential-kernel Gaussian process is the stationary Ornstein-Uhlenbeck process, which is Markov.