Pairwise independent events describe a subtle kind of uncertainty: learning that one event occurred leaves each other event's probability unchanged, yet learning that two occurred can reveal a third completely. Checking every pair therefore answers a weaker question than checking the whole collection. The parity construction of pairwise independent bits makes this distinction visible with just four equally likely outcomes.
A family of events is pairwise independent when
If , this is equivalent to the conditional probability identity . The product definition also handles events of probability zero. Independent events, meaning mutually independent events, require the same product rule for every finite subfamily, including triples. For three events, the three pair equations and the triple equation are four separate requirements. [ref].
For a worked example, take independent fair bits : the sample space is with probability per outcome. Set , , and , using exclusive or, which is one precisely when its inputs differ. The events , , and each contain two outcomes. Their pair intersections are
Thus each event has probability and each pair intersection has probability : these are pairwise independent events. But forces , so
The three are not independent events. This is the complementary-third-event version of the two-toss example in Tsitsiklis and Jaillet, MIT Introduction to Probability, Lecture 3, slides 7–8.
Figure 1.
Four outcomes give three pairwise independent bits with a joint parity constraint
. Each row has probability . Each pair's joint probability mass function contains all four value combinations with probability , although only four of the eight triple combinations can occur. Details.
Another useful diagnostic preserves a special common-intersection case. Suppose three events have common probability and every pair and triple intersect in the same event, of probability . Pairwise independence requires , while mutual independence additionally requires . Both hold only for or . For a concrete nontrivial instance, assign probability to each of four outcomes, let all three events contain the first outcome, and give each event one different additional outcome. Then and : the pair equations hold, while the triple equation fails. Unlike the exclusive or example above, this triple intersection is nonempty.

Articles by others on the same topic (NaN)

There are currently no matching articles.