For , the Poisson distribution gives
This information entropy is finite: for integer , while .
Fix . Take independent random variables and . Their convolution is
by the binomial theorem. Thus has Poisson distribution with parameter . Conditioning on only translates , so . The entropy monotonicity under independent addition yields .
In fact the inequality is strict. The covariance is positive, so and are not independent random variables. Their information entropies are finite, and the equality criterion from part (a) excludes equality. Therefore the Poisson entropy monotonicity gives the stronger conclusion
The information entropy of a Poisson distribution is strictly increasing for . Given , take independent and . Their sum has Poisson distribution with mean , so entropy monotonicity under independent addition gives . All these information entropies are finite, and excludes equality.