Source: wikibot/information-theory-and-measure-theory

= Information theory and measure theory
{wiki=Information_theory_and_measure_theory}

**Information Theory** and **Measure Theory** are two distinct fields within mathematics and applied science, each with its own concepts and applications. \#\#\# Information Theory **Information Theory** is a branch of applied mathematics and electrical engineering that deals with the quantification, storage, and communication of information. It was founded by Claude Shannon in the mid-20th century. Key concepts in information theory include: 1. **Entropy**: A measure of the uncertainty or unpredictability of information content.