Supermartingale majorant bound (source code)

= Supermartingale majorant bound

Let an <integrable> <adapted> reward process $Z$ be dominated by a <supermartingale> $V$ over a finite discrete horizon. For every <bounded stopping time> $\tau$ within that horizon, the <optional stopping theorem> gives
$$
\mathbb E[Z_\tau\mid\mathcal F_0]\leq V_0,\qquad \mathbb EZ_\tau\leq\mathbb EV_0.
$$
When $V_0$ is a deterministic constant, the latter bound is $\mathbb EZ_\tau\leq V_0$. An expectation is required on the right when $V_0$ is random. The <Snell envelope> is the least such <supermartingale> majorant and turns this upper bound into the optimal expected reward. For continuous time, use a <càdlàg> <supermartingale> under the <usual conditions for a filtration> and ensure integrability of the stopped reward.