Solution (source code)

= Solution

Put $Z_i=f_i(X^{(i)})$ and $\Delta_i=Z-Z_i$. The <weakly self-bounding function> assumptions give $\Delta_i\geq0$ and $\sum_i\Delta_i^2\leq Z$. For $0\leq\lambda<2$, the bound $\phi(-x)\leq x^2/2$ and the <modified logarithmic Sobolev inequality> imply
$$
\operatorname{Ent}(e^{\lambda Z})
\leq\frac{\lambda^2}{2}\mathbb E[Ze^{\lambda Z}].
$$
Let $H(\lambda)=\log\mathbb Ee^{\lambda Z}$. Dividing by $\mathbb Ee^{\lambda Z}$ turns this into
$$
\lambda H'(\lambda)-H(\lambda)
\leq\frac{\lambda^2}{2}H'(\lambda),
$$
and therefore
$$
\frac{H'(\lambda)}{H(\lambda)}
\leq\frac1{\lambda(1-\lambda/2)}.
$$
Since $H(\lambda)\sim\lambda\mathbb EZ$ as $\lambda\downarrow0$, integration gives
$$
H(\lambda)
\leq\frac{2\lambda\mathbb EZ}{2-\lambda}.
$$
Subtracting $\lambda\mathbb EZ$ from both sides yields
$$
\log\mathbb E e^{\lambda(Z-\mathbb EZ)}
\leq\frac{\lambda^2\mathbb EZ}{2-\lambda},
$$
as required. This is a <Herbst argument> with a variance proxy controlled by $Z$ itself.