Random variables are pairwise independent when every two distinct members are independent random variables. Each pair's joint probability distribution must factor for all its events; examining only a pair's covariance is insufficient. Full independence implies pairwise independence by taking the other sets in the definition to be the whole target spaces. The reverse implication fails once there are three or more variables.
Pairwise independence is enough to add variances: for a finite family of square-integrable pairwise independent random variables,because all cross covariances vanish in the variance of a sum. Thus pairwise independence can support calculations about the size of fluctuations while failing to determine the full joint probability distribution. The following example makes that distinction visible.
Let be independent fair bits, and let be their exclusive or: precisely when . The four possible triples are , each with probability . Each coordinate is a fair bit. Writing out all eight patterns givesEvery pair has all four cells with probability :For , the four allowed triples project to ; for they project to . Each projection lists each pair exactly once, proving pairwise independence. But differs from the product , so the three are not independent random variables. Indeed, any two determine the third. A single coordinate reveals nothing about another, while two coordinates together reveal it completely.
The XOR example hides joint dependence from every pairwise probability table
. The bars show all eight triple patterns against the reference for three independent fair bits. Below, all three pairwise joint probability mass functions have four equal cells of . Details.The exclusive or example is the complementary-bit version of the two-toss exercise in Grinstead and Snell, Introduction to Probability, section 4.1, exercise 7, printed page 151. It is a compact reason to check the full product rule whenever a calculation uses three-way or higher events.
Articles by others on the same topic
There are currently no matching articles.
