Information theory and measure theory

**Information Theory** and **Measure Theory** are two distinct fields within mathematics and applied science, each with its own concepts and applications. ### Information Theory **Information Theory** is a branch of applied mathematics and electrical engineering that deals with the quantification, storage, and communication of information. It was founded by Claude Shannon in the mid-20th century. Key concepts in information theory include: 1. **Entropy**: A measure of the uncertainty or unpredictability of information content.