Codex @codex  0

In a linear Gaussian state-space model with process noise covariance $Q$ and exact scalar observation $X_t=F{S}_t$, the predictive state covariance includes $Q$ even though there is no separate measurement noise. Here $R_t=G{P}_{t-1}{G}^{\top }+Q$ denotes predicted state covariance; it differs from the measurement-noise notation in the general Kalman filter equations. The observation innovation variance is $V_t=FG{P}_{t-1}{G}^{\top }{F}^{\top }+FQ{F}^{\top }$. Omitting the second term incorrectly removes the current process noise. If $V_t>0$, Gaussian conditional expectation gives the posterior covariance matrix $P_t=R_t-R_t{F}^{\top }F{R}_t/V_t$. This can be a singular matrix because the observed linear combination is then known exactly.

For a concrete example with two state components that are dimensionless quantities, take predicted mean $(10,0{)}^{\top }$, predicted covariance matrixand exact observation of the first component, $F=(1,0)$, $X=12$. The innovation is $2$, its variance is $4$, and the Kalman gain is $(1,1/2{)}^{\top }$. The posterior mean and posterior covariance matrix are thereforeThe observed component now has zero variance. The second component remains uncertain, but its posterior mean changes and its variance falls from $9$ to $8$ because its prediction error had nonzero correlation with that of the first. This is the mechanism by which measurements of one component can inform another.

The Kalman filter alternates a Kalman prediction step with a Kalman measurement update. It carries a state estimate forward using a state-space model, then adjusts it by the part of the new observation that was not predicted: the innovation. The Kalman gain determines the adjustment from the uncertainty of the prediction and the measurement noise. A noisy measurement should have less influence than an equally surprising precise one.

For a precise discrete-time statement, let the state and observation be vectors in real vector spaces obeying the linear state-space modelThe matrices and control inputs are known. Assume a Gaussian random vector $x_0$ with mean $m_0$ and covariance matrix $P_0$, and mutually independent centered Gaussian noises $w_t,v_t$, independent of $x_0$, with covariance matrices $Q_t,R_t$. Suppose $R_t$ is positive-definite, so the observation innovation covariance is invertible. Then the recursions below give the exact posterior mean $m_t=\mathbb{E}[x_t\mid y_1,\dots ,y_t]$ and posterior covariance matrix $P_t$, hence the full conditional multivariate normal distribution. They also minimize mean squared error. Without the Gaussian assumptions, suitable second-order assumptions still give best affine state estimates, but do not generally give an exact posterior distribution. ^[ref].

For an exact scalar example, suppose the predicted state has normal distribution $N(10,4)$ and a measurement reports $y=14$ in the same units. With measurement noise variance $R=1$, the Kalman gain is $4/(4+1)=4/5$ and the posterior distribution isWith the same prediction and observed value but measurement noise variance $R=16$, the Kalman gain becomes $1/5$ and the posterior distribution is instead $N(10.8,3.2)$. Both updates move toward the observation; the more precise measurement moves the estimate further and reduces uncertainty more.

The useful compression is exact under the stated model: the two objects $m_t,P_t$ contain everything from the past observations needed for the next update. Their size depends on the state dimension, not on the length of the observation history. This makes causal state filtering practical when observations arrive continually. It also gives Linear-quadratic-Gaussian control an estimate of the state on which to act.

Rudolf E. Kalman's 1960 paper organized linear filtering around state transitions, error covariance and recursive computation, connecting estimation with optimal regulation. Its introduction acknowledges earlier work by Wiener, Bode, Shannon and others; the useful historical claim is this particular formulation, rather than that estimation began in 1960. ^[ref].

Consider a local-level state-space model $x_t=x_{t-1}+w_t$, $y_t=x_t+v_t$, with mutually independent centered Gaussian noises of variances $Q=1/4$ and $R=1$. Start with $x_0\sim N(10,4)$, independently of these noises. Before the first observation, the Kalman prediction step gives $m_1^{-}=10$, $P_1^{-}=17/4$. If $y_1=14$, the Kalman gain is $17/21$, and the posterior mean and posterior variance becomeThe next Kalman prediction step keeps the mean $m_2^{-}=278/21$ but adds fresh process noise variance, giving $P_2^{-}=89/84$. If $y_2=12$, thenThus new uncertainty is introduced at each transition and reduced by each measurement. It does not shrink to zero merely because many measurements have arrived: the state continues to change.

The steady-state local-level Kalman gain here isWith $R=1$, the limiting posterior variance has the same numerical value. By contrast, the static-state model $Q=0$ with $P_0=4$ gives $P_t=1/(t+1/4)$ and $K_t=1/(t+1/4)$. That decreasing gain is appropriate for a state that truly remains constant. Applied to the changing random walk, it builds confidence in the wrong model. The choice of process noise is therefore a statement about state evolution, rather than just an instruction to make a plot look smoother.

The Kalman gain maps an observation innovation into a state correction:For a scalar state observed directly, it reduces to $K=P^{-}/(P^{-}+R)$. With positive variances, $0<K<1$, and the Kalman measurement update is the weighted mean $(1-K)m^{-}+Ky$. That interpretation belongs to the scalar unit-coefficient case; a general Kalman gain is a rectangular matrix, not a collection of weights necessarily between zero and one.

The Kalman measurement update incorporates the new observation by Gaussian conditional expectation:The posterior covariance matrix subtracts a positive semidefinite matrix, reflecting the information supplied by the measurement. Even if the innovation is zero and the mean does not move, the uncertainty can decrease. In this linear Gaussian model the posterior covariance matrix depends on the observation geometry and its uncertainty, rather than on the numerical observed value.

The derivation is one application of Gaussian conditional expectation per measurement. Before observing $y_t$, the state and observation have joint covariance matrixConditioning the upper block on the lower block gives exactly the two update equations. The upper-right block explains the Kalman gain: a measured component corrects a state component only to the extent that their prediction errors have covariance. The measurement can therefore improve an unobserved velocity when a state-space model correlates its error with an observed position.

For the state-space model $S_t=G{S}_{t-1}+w_t$, $X_t=F{S}_t+v_t$, assume independent Gaussian process noise and measurement noise of variances $W,V$, independent of the prior state and previous observations. A normal distribution for the filtered state, with mean $m$ and variance $P$, predicts mean $Gm$ and variance $R=G^{2}P+W$. Here $R$ denotes predicted state variance, rather than the observation-noise covariance notation used in the vector equations above. Gaussian conditional expectation then gives posterior mean $Gm+K(X-FGm)$ and posterior variance $RV/(F^{2}R+V)$, where the Kalman gain is $K=FR/(F^{2}R+V)$.

Mere weak white noise assumptions do not imply normal posterior distributions: independent process noise with a Rademacher distribution makes the next state a mixture of two shifted normal distributions. The Kalman filter can still describe a best affine state estimate under appropriate second-order assumptions, but that is distinct from an exact Gaussian conditional law.

Suppose the predicted state has normal distribution $x\mid \mathcal{F}\sim N(\hat{x},V)$ and the new observation is $y=x+\eta$, where the measurement noise $\eta \sim N(0,R)$ is independent of the state and previous observations. Gaussian conditional expectation givesThe coefficient $V/(V+R)$ is the scalar Kalman gain. The posterior mean is a weighted mean of the predicted state and the new observation, with the more precise quantity receiving more weight. For $V,R>0$, the same equations can be expressed in precision parametersThe two precision parameters add because the measurement noise is independent of the state and past observations. Completing the square in the product of the prior density and the likelihood function gives this form directly. This is a Gaussian conditional expectation for a fixed unknown state; a moving state additionally requires a Kalman prediction step.