Characteristic function of a sum of independent variables

Independence makes the characteristic function of a sum equal the product of the individual characteristic functions.

For mutually independent random variables $X_1,\dots ,X_n$, write $S_n={\sum }_{j=1}^n{X}_j$. ThenThis is the expectation of a product of independent random variables applied to bounded complex exponentials; no moment hypothesis is needed.^[ref]

Identical probability distributions are unnecessary. When the random variables are independent and identically distributed random variables, the product is ${\phi }_X(t{)}^n$. A deterministic rescaling also follows directly from the definition: ${\phi }_{aX+b}(t)=e^{itb}{\phi }_X(at)$ for real $a,b$. Consequently the sample mean has characteristic function ${\phi }_X(t/n{)}^n$, and a sum divided by $\sqrt{n}$ has characteristic function ${\phi }_X(t/\sqrt{n}{)}^n$.

The independence assumption does real work. Let $X$ take $-1$ and $1$ with equal probabilities and set $Y=X$. Both characteristic functions are $\cos t$, but ${\phi }_{X+Y}(t)=\cos (2t)$, not ${\cos }^{2}t$. At $t=\pi /2$ they give $-1$ and zero respectively. Knowing the two marginal probability distributions does not determine the sum without their joint probability distribution.

Let $B_1,B_2,B_3$ be independent random variables, each with the Bernoulli distribution of parameter $1/3$, and let $S=B_1+B_2+B_3$. Multiplying their characteristic functions and expanding by the binomial theorem givesThe coefficients are exactly the probability mass function of the binomial distribution with parameters $3,1/3$: the sum takes $0,1,2,3$ with probabilities $8/27,12/27,6/27,1/27$. Direct outcome counting verifies them: an outcome with $k$ ones has probability $(1/3{)}^k(2/3{)}^{3-k}$, and there are $\left(\genfrac{}{}{0ex}{}{3}{k}\right)$ such outcomes. The coefficients sum to one, recovering ${\phi }_S(0)=1$.

At $t=\pi$, ${\phi }_S(\pi )=(1/3{)}^3=1/27$. This is also $\mathbb{P}(S\text{ even})-\mathbb{P}(S\text{ odd})=(8+6-12-1)/27$: the complex exponential now records parity. The moments agree by two routes: linearity of expectation gives $\mathbb{E}[S]=1$, while the variance of a sum of independent random variables gives $\mathrm{Var}(S)=3(2/9)=2/3$. Summing $k^2\mathbb{P}(S=k)$ gives the second moment $5/3$, also recovered as $-{\phi }_S^{\prime \prime }(0)$.

Let $X_1,X_2,\dots$ be independent and identically distributed random variables taking $-1$ and $1$ with equal probabilities, the Rademacher distribution. The two opposite complex exponentials give ${\phi }_X(t)=(e^{it}+e^{-it})/2=\cos t$. Their expected value is zero and their variance is one. For $S_n={\sum }_{j=1}^n{X}_j$, the characteristic functions of its sample mean and its variance normalization are respectivelyFor each fixed $t$, the bases are positive for all sufficiently large $n$. The Taylor expansion $\log \cos u=-u^2/2+O(u^4)$ at zero then givesExponentiating proves the two displayed pointwise limits. The first limit is the characteristic function of the constant zero; the second is that of the standard normal distribution. The Lévy continuity theorem gives the corresponding convergence in distribution statements. Averaging has variance $1/n$, whereas dividing the sum by $\sqrt{n}$ preserves variance one. This sign calculation illustrates why the law of large numbers and the central limit theorem use different scales; it is not a proof for arbitrary probability distributions.