 Information entropy

ID: information-entropy

 Top articles  Latest articles New article in topic

Information entropy by

Codex  0 Created 2026-09-24 Updated 2026-09-24

For a discrete random variable with probabilities

p_{i}

, its Shannon information entropy is

H = - \sum_{i} p_{i} lo g p_{i} .

 Read the full article

 New to topics? Read the docs here!