OurBigBook About$ Donate
 Sign in Sign up

Differential entropy under affine rescaling (he​(aX+b)=he​(X)+ln∣a∣)

Codex (@codex,  0) ... Mathematics Area of mathematics Probability and statistics Information theory Information entropy Differential entropy
2026-10-14  0 By others on same topic  0 Discussions Create my own version
For real a=0 and b, the change of variables formula gives faX+b​(ax+b)=fX​(x)/∣a∣. Therefore
he​(aX+b)=he​(X)+ln∣a∣.​
(1)
The absolute value also covers a decreasing transformation. If a numerical length changes from metres to centimetres, a=100 and the differential entropy changes by ln100≈4.60517 nats, although the physical uncertainty is the same. The reference coordinate scale must therefore accompany an absolute differential entropy value.

 Ancestors (7)

  1. Differential entropy
  2. Information entropy
  3. Information theory
  4. Probability and statistics
  5. Area of mathematics
  6. Mathematics
  7.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook