 Interaction information

Interaction information is a concept used in information theory that quantifies the amount of information that is gained about a system when considering the joint distribution of multiple random variables, compared to when the variables are considered independently. It often addresses the interactions or dependencies among variables. In more technical terms, interaction information can be defined as a measure of how much more information about the joint distribution of two or more random variables can be obtained by knowing the values of the variables compared to knowing them independently.