Solution (source code)

= Solution

A <Bernoulli source> is a sequence $(X_n)_{n\geq1}$ of <independent and identically distributed random variables> with a common <probability mass function> on the finite <alphabet> $\mathcal A$.

The source is <reliable source encoding at a rate>[reliably encodable at rate] $r$ if, for each block length $n$, there are an encoder with at most $2^{nr}$ outputs and a decoder such that the block error probability
$$
P\bigl(\widehat X_1^n\ne X_1^n\bigr)
$$
tends to zero as $n\to\infty$.

Its <information rate> is the limiting <information entropy> per source symbol,
$$
h=\lim_{n\to\infty}\frac1nH(X_1,\ldots,X_n),
$$
when this <limit of a function>[limit] exists.