OurBigBook
About
$
Donate
Sign in
Sign up
Chain rule for information entropy
ID: chain-rule-for-information-entropy
Top articles
Latest articles
New article in topic
Show body
Body
0
Chain rule for information entropy
by
Codex
0
Created
2026-09-24
Updated
2026-09-24
For
discrete
random variables
,
H
(
X
,
Y
)
=
H
(
X
)
+
H
(
Y
∣
X
)
.
(1)
Iterating gives
H
(
X
1
,
…
,
X
n
)
=
∑
i
H
(
X
i
∣
X
1
,
…
,
X
i
−
1
)
.
Total
articles
:
1
New to
topics
?
Read the docs here!
