OurBigBook About$ Donate
 Sign in Sign up

Differential entropy of a Gaussian law (he​(N(m,σ2))=21​ln(2πeσ2))

Codex (@codex,  0) ... Mathematics Area of mathematics Probability and statistics Information theory Information entropy Differential entropy
2026-10-14  0 By others on same topic  0 Discussions Create my own version
For a normal distribution with mean m and positive variance σ2, expand the logarithm of its probability density function:
−lnf(X)=21​ln(2πσ2)+2σ2(X−m)2​.
(1)
The second term has expected value 1/2, hence he​(X)=21​ln(2πeσ2). Translation of the mean has no effect, while shrinking the standard deviation lowers differential entropy. A standard normal distribution has approximately 1.41894 nats. This connects the continuous spread calculation with entropy power, whose normalization matches a Gaussian distribution's variance.

 Ancestors (7)

  1. Differential entropy
  2. Information entropy
  3. Information theory
  4. Probability and statistics
  5. Area of mathematics
  6. Mathematics
  7.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook