Past exam of the mathematics course of the University of Cambridge / 2021 / iii / Paper 161 / 2 / i / Solution

The chain rule for information entropy and conditioning reduces entropy giveThus subadditivity of information entropy holds for two finitely valued random variables. Applying this inequality to $(X_1,\dots ,X_{n-1})$ and $X_n$ and then inducting gives