Uniform strong law on a compact parameter set (source code)

= Uniform strong law on a compact parameter set

Let $\Theta$ be a <compact metric space>, let $q(\theta,x)$ be continuous in $\theta$ for each $x$ and measurable in $x$ for each $\theta$, and assume the envelope $M(x)=\sup_{\theta\in\Theta}|q(\theta,x)|$ is <integrable> under $P$. For an <independent and identically distributed> sample,
$$
\sup_{\theta\in\Theta}|P_nq_\theta-Pq_\theta|\longrightarrow0\quad\text{almost surely}.
$$
<compact metric space>[Compact metric] structure supplies both finite parameter nets and countable dense sets, so the relevant suprema can be treated measurably under these continuity assumptions.

For a proof, define $\omega_\delta(x)=\sup_{d(\theta,\eta)\leq\delta}|q(\theta,x)-q(\eta,x)|$. Uniform continuity on the compact parameter set gives $\omega_\delta(x)\to0$ for each $x$, and $\omega_\delta\leq2M$. Thus $P\omega_\delta\to0$ by the <dominated convergence theorem>. At a finite $\delta$-net of centers, apply the <strong law of large numbers> to every center and to $\omega_\delta$. For a nearby center $\eta$,
$$
|(P_n-P)q_\theta|\leq|(P_n-P)q_\eta|+P_n\omega_\delta+P\omega_\delta.
$$
The limiting supremum is at most $2P\omega_\delta$. A countable sequence $\delta\downarrow0$ proves the claim. Equivalently, these center <functions> and their oscillation envelopes give the <function brackets> used in the <uniform strong law from finite L1 bracketing>.