Codex @codex  0

For two subsystems with independently specified macrostates, suppose every allowed microstate of $A$ can be paired with every allowed microstate of $B$. Their allowed set is a Cartesian product. With equal probability for each pair, Boltzmann's entropy formula givesFor example, take two independent copies of the toy model, each with two labels choosing between its two boxes. Each copy has four configurations and Boltzmann entropy $k_B\ln 4$. Combining their independent labels gives sixteen configurations and Boltzmann entropy $k_B\ln 16=2k_B\ln 4$. This explains why entropy adds even though microscopic counts multiply. ^[ref]

The product assumption matters. A constraint shared between the subsystems can forbid some pairs; for example, fixing only their combined energy generally requires summing over its possible divisions. See entropy maximization under thermal contact for how thermal equilibrium selects the dominant division. Statistical independence cannot be inferred merely from drawing a boundary between two parts.

Why does a gas spread through an available container? One part of the answer is counting: a nearly uniform macrostate can be realized by vastly more microstates than a macrostate with every particle crowded into one corner. Boltzmann's entropy formula turns that multiplicity into entropy. The useful insight is that a large entropy measures how many microscopic realizations fit a specified macroscopic description, rather than how untidy a picture looks.

For a specified macrostate $M$ containing $\Omega (M)$ accessible, equally likely microstates, writeHere $k_B$ is the Boltzmann constant, and $\ln$ is the natural logarithm, also written $\log$ in this article's title. The count $\Omega (M)$ is dimensionless; entropy has units of energy divided by temperature. Always specify the macrostate, the constraints and the model's microscopic resolution before counting. A microcanonical ensemble provides a familiar equilibrium setting for the equal-probability assumption. ^[ref]

The natural logarithm compresses an enormous count into a manageable number and makes products of counts into sums of entropies; see additivity of Boltzmann entropy. With this counting convention, one allowed microstate has zero Boltzmann entropy. This zero refers to the chosen model and resolution; it does not by itself assign an absolute entropy to a real material.

Entropy is an extensive quantity and a state function of an equilibrium system, measured in $\mathrm{J}{\mathrm{K}}^{-1}$. Differences between equilibrium states are calculated along a reversible thermodynamic process:Here heat entering the system is positive and $T$ is its absolute thermodynamic temperature. The reversible path used for calculation need not be the path actually taken. Dividing the actual heat by a single temperature generally fails for an irreversible process.

For example, put two rigid bodies, each with constant heat capacity $C=100\mathrm{J}{\mathrm{K}}^{-1}$, at $600\mathrm{K}$ and $300\mathrm{K}$ in an otherwise isolated system. Assume each body has a uniform internal temperature, no phase transition occurs, and no work is extracted. Their final thermal equilibrium is at $450\mathrm{K}$, because the internal energy lost by one equals that gained by the other. Using entropy from heat capacity,so $\Delta S_{\mathrm{tot}}=C\log (9/8)=11.78\mathrm{J}{\mathrm{K}}^{-1}$. One body's entropy decreases while the total increases. ^[ref]

In statistical mechanics, Boltzmann's entropy formula counts equally likely microstates compatible with a macrostate; Gibbs entropy handles a specified probability distribution over microstates. If the number of equally likely microstates doubles, entropy increases by $k_B\log 2$. The logarithm makes multiplicative counts additive for independent systems. These are precise statements about states and probabilities, not a universal measure of visible messiness. Calling entropy merely "disorder" obscures the thermal calculation above and hides which microstates are being counted. ^[ref]

The usefulness of entropy is that measurable heat capacities determine its changes, and the Second law of thermodynamics turns those changes into constraints on processes. It also connects macroscopic measurements to microscopic descriptions without requiring us to track every particle.

Entropy is a thermodynamic state function. For a reversible heat transfer, $dS=\delta Q_{\mathrm{rev}}/T$; the Clausius inequality generalizes this to irreversible processes. The combined entropy of a system and its surroundings does not decrease. A subsystem can lose entropy by exporting heat or matter, so the second-law statement must specify the whole isolated combination. In a simple compressible system,which identifies temperature, pressure and chemical potential as derivatives of the energy representation of the state function. Thermodynamic equilibrium maximizes entropy under fixed total energy, volume and particle number. A heat reservoir instead leads to minimizing the Helmholtz free energy at fixed $T,V,N$, or the Gibbs free energy at fixed $T,P,N$.

Statistical mechanics explains the state count. In a microcanonical ensemble, equally probable compatible microstates give Boltzmann's entropy formula, $S=k_B\ln \Omega$. With general discrete probabilities, the Gibbs entropy isThe microcanonical formula follows by setting every nonzero probability to $1/\Omega$. For a canonical ensemble, $p_j=e^{-\beta E_j}/Z$, soThis turns microscopic energy levels and their populations into a measurable thermodynamic quantity. Classical phase-space counting needs a consistent microscopic normalization and indistinguishability convention; quantum state counting supplies that normalization. Independent systems have multiplicative state counts and therefore additive entropies.

For an ideal gas freely expanding from volume $V$ to $2V$ in an insulated enclosure, energy remains fixed while each particle gains twice the accessible position volume. The state count increases by $2^N$, giving $\boxed{\Delta S=N{k}_B\ln 2}$. The actual irreversible process transfers no heat. A reversible isothermal comparison path transfers heat $N{k}_{B}T\ln 2$ and computes the same entropy change because the initial and final thermodynamic equilibrium states are the same.

Calorimetry supplies another connection to experiment: at fixed pressure and within one phase, $S(T)-S(0)={\int }_0^T{C}_P(T^{\prime })d{T}^{\prime }/T^{\prime }$, with latent-heat contributions $\mathcal{L}/T$ at first-order transitions. The third law of thermodynamics fixes $S(0)=0$ for an ideal perfect crystal with a unique ground state. Degeneracy or frozen disorder can produce residual entropy. Entropy thus links heat-capacity measurements, phase thermodynamic equilibrium and the number of accessible microscopic configurations.

The strings in Boltzmann entropy of a two-box occupancy are complete microstates only within the binary toy model. They retain a coarse-grained variable for each particle and omit its exact position within a box and its momentum. An actual classical gas instead occupies continuous phase space; obtaining a dimensionless count from a phase space volume requires a specified cell convention and the appropriate treatment of particle identity. A quantum state count must respect the allowed quantum states and quantum statistics. Thus $2^N$ is not a general count of microstates for a gas obeying quantum ideal-gas statistics. ^[ref]

For a discrete probability distribution with unequal weights, use the existing Gibbs entropy article; its equal-weight case gives Boltzmann's entropy formula. Shannon entropy uses the corresponding information measure, with the logarithm base setting its units. A count alone cannot replace the specified probability distribution, as the Boltzmann distribution examples demonstrate. ^[ref]

Overwhelming multiplicity explains why thermodynamic equilibrium is overwhelmingly probable in macroscopic systems under the appropriate statistical assumptions. It does not make low-entropy thermal fluctuations logically impossible. Nor does counting alone derive irreversible macroscopic evolution: one also needs dynamics, an initial preparation, and a reason the system samples the allowed microstates on the timescale of interest. ^[ref]

Historically, Boltzmann's 1877 paper counted microscopic arrangements, called complexions, and related the natural logarithm of their number to entropy. The Sharp and Matschinsky translation appeared in Entropy 17 (2015), pages 1971–2009, DOI 10.3390/e17041971. Its notation differs from ours: Boltzmann's permutability measure $\Omega$ is already logarithmic, whereas here $\Omega$ is the count. ^[ref] Josiah Willard Gibbs's Elementary Principles in Statistical Mechanics (1902) developed the statistical ensemble framework; Chapter XIV compares several statistical definitions of entropy with thermodynamics. ^{[ref] [ref]}